[ 530.819690] env[68828]: INFO neutron.common.config [-] Logging enabled! [ 530.820096] env[68828]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev38 [ 530.820222] env[68828]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68828) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 530.820491] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 530.820592] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 530.821432] env[68828]: WARNING oslo_policy.policy [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 530.821800] env[68828]: WARNING oslo_policy.policy [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 530.823152] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] VMware NSXv3 Agent initialized successfully. [ 530.823502] env[68828]: DEBUG oslo_concurrency.lockutils [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] Acquiring lock "singleton_lock" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.823641] env[68828]: DEBUG oslo_concurrency.lockutils [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] Acquired lock "singleton_lock" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.823851] env[68828]: DEBUG oslo_concurrency.lockutils [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] Releasing lock "singleton_lock" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.824165] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] Full set of CONF: {{(pid=68828) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 530.824381] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ******************************************************************************** {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 530.824503] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] Configuration options gathered from: {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 530.824744] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 530.824919] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 530.825046] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ================================================================================ {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 530.825228] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] agent_down_time = 75 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.825424] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] allow_automatic_dhcp_failover = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.825521] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] allow_bulk = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.825670] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] api_extensions_path = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.825816] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] api_paste_config = api-paste.ini {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.825965] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] auth_strategy = keystone {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826091] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] backdoor_port = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826201] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] backdoor_socket = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826344] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] backlog = 4096 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826491] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] base_mac = fa:16:3e:00:00:00 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826679] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] bind_host = 0.0.0.0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826846] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] bind_port = 9696 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.826995] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] client_socket_timeout = 900 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.827169] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] config_dir = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.827279] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.827422] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] config_source = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.827569] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] control_exchange = neutron {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.827715] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] core_plugin = ml2 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.827858] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] debug = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828009] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] default_availability_zones = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828228] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828375] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] dhcp_agent_notification = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828518] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] dhcp_agents_per_network = 1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828658] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] dhcp_lease_duration = 86400 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828835] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] dhcp_load_type = networks {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.828977] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] dns_domain = openstacklocal {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.829138] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.829283] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_default_route_bfd = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.829426] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_default_route_ecmp = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.829570] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_dvr = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.829712] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_new_agents = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.829875] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_services_on_agents_with_admin_state_down = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.830029] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_signals = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] enable_traditional_dhcp = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] external_dns_driver = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] filter_validation = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] global_physnet_mtu = 8950 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] graceful_shutdown_timeout = 60 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] host = cpu-1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.833963] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] host_dvr_for_dhcp = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834457] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] http_retries = 3 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834457] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] instance_format = [instance: %(uuid)s] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834457] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834457] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ipam_driver = internal {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834457] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ipv6_pd_enabled = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834457] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] l3_ha = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] l3_ha_network_physical_name = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] l3_ha_network_type = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_color = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_config_append = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_dir = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834791] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_file = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834791] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_options = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834791] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_rotate_interval = 1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834791] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_rotate_interval_type = days {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834791] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] log_rotation_type = none {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834791] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] max_dns_nameservers = 5 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.834992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] max_header_line = 16384 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] max_l3_agents_per_router = 3 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] max_logfile_count = 30 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] max_logfile_size_mb = 200 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] max_subnet_host_routes = 20 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] my_ip = 10.180.1.21 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] my_ipv6 = ::1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835308] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] network_auto_schedule = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835576] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] network_link_prefix = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835576] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835712] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] notify_nova_on_port_data_changes = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.835859] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] notify_nova_on_port_status_changes = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836017] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] pagination_max_limit = -1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836149] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] publish_errors = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836284] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] rate_limit_burst = 0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836426] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] rate_limit_except_level = CRITICAL {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836561] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] rate_limit_interval = 0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836719] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] retry_until_window = 30 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836862] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] router_distributed = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.836999] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] rpc_resources_processing_step = 20 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837147] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] rpc_response_max_timeout = 600 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837286] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] rpc_response_timeout = 60 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837421] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] send_events_interval = 2 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837594] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] service_plugins = ['router'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837716] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] setproctitle = on {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837853] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] shell_completion = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.837992] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] state_path = /opt/stack/data/neutron {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.838147] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] syslog_log_facility = LOG_USER {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] tcp_keepidle = 600 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] transport_url = **** {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] use_journal = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] use_json = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] use_ssl = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] use_stderr = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] use_syslog = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839709] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] vlan_qinq = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839709] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] vlan_transparent = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839709] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] watch_log_file = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.839709] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] wsgi_default_pool_size = 100 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.840118] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] wsgi_keep_alive = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.840118] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.840118] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] wsgi_server_debug = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.840265] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_concurrency.disable_process_locking = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.840422] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.840576] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.840720] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.840869] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841027] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841175] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841334] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.connection_string = messaging:// {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841482] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.enabled = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841631] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.es_doc_type = notification {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841780] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.es_scroll_size = 10000 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.841929] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.es_scroll_time = 2m {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842080] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.filter_error_trace = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842231] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.hmac_keys = **** {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842378] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.sentinel_service_name = mymaster {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842525] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.socket_timeout = 0.1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842669] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.trace_requests = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842811] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler.trace_sqlalchemy = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.842968] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler_jaeger.process_tags = {} {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.843120] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler_jaeger.service_name_prefix = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.843265] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] profiler_otlp.service_name_prefix = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.843423] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.enforce_new_defaults = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.843690] env[68828]: WARNING oslo_config.cfg [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 530.843851] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.enforce_scope = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844023] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.policy_default_rule = default {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844180] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844330] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844480] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844621] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844760] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.844899] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845055] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845204] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_policy.remote_timeout = 60.0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845360] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845512] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] agent.extensions = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845660] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845810] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] service_providers.service_provider = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.845966] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.default_quota = -1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.846126] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.846268] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_floatingip = 50 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.846410] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_network = 100 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.846549] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_port = 500 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.846711] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_rbac_policy = 10 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.846865] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_router = 10 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847017] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_security_group = 10 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847163] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_security_group_rule = 100 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847302] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.quota_subnet = 100 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847441] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] QUOTAS.track_quota_usage = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847596] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847734] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep.group = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.847872] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep.helper_command = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848018] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep.logger_name = oslo_privsep.daemon {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848164] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep.thread_pool_size = 8 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848300] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep.user = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848446] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848583] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_dhcp_release.group = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848719] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_dhcp_release.helper_command = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.848888] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849044] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849186] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_dhcp_release.user = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849333] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849471] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_ovs_vsctl.group = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849606] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_ovs_vsctl.helper_command = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849760] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.849915] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850065] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_ovs_vsctl.user = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850210] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_namespace.capabilities = [21] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850345] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_namespace.group = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850481] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_namespace.helper_command = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850623] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850770] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_namespace.thread_pool_size = 8 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.850911] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_namespace.user = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851069] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_conntrack.capabilities = [12] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851208] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_conntrack.group = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851346] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_conntrack.helper_command = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851490] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851633] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_conntrack.thread_pool_size = 8 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851770] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_conntrack.user = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.851921] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_link.capabilities = [12, 21] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852068] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_link.group = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852207] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_link.helper_command = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852347] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852485] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_link.thread_pool_size = 8 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852622] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] privsep_link.user = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852780] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.852929] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853084] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.continue_on_failed_promotions = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853229] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.dscp = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853371] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.dscp_inherit = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853516] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.force_mp_to_policy = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853655] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.locking_coordinator_url = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853796] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.log_agent_heartbeats = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.853938] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.logging_expire = 1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854096] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854241] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854390] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.polling_interval = 240 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854533] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854680] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.quitting_rpc_timeout = 120 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854824] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.report_interval = 30.0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.854976] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.855134] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.855280] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.855423] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.sync_skew = 60 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.855564] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.synchronization_queue_size = 20 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.855708] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT.use_helper_for_ns_read = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.855857] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] SECURITYGROUP.enable_ipset = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856014] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] SECURITYGROUP.enable_security_group = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856169] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856314] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856462] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] experimental.ipv6_pd_enabled = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856628] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.extension_drivers = ['port_security'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856790] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.external_network_type = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.856951] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.857114] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.overlay_ip_version = 4 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.857263] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.path_mtu = 8950 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.857409] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.physical_network_mtus = {} {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.857563] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.tenant_network_types = ['vlan'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.857712] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.857864] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ml2.type_drivers = ['vlan'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858026] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT_CLI.neutron_port_id = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858171] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858314] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858465] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858616] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858786] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.858939] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.859104] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.859254] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.859449] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.859602] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_login_password = **** {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.859765] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_login_port = 443 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.859929] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_login_user = admin {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860087] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860246] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860385] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860531] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860681] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860835] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.860985] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.861144] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.861290] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.861439] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.861591] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.861736] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.861885] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862093] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862251] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] vsphere.vsphere_login_password = VMware1! {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862397] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862541] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862687] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.auth_section = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862838] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.auth_type = password {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.862986] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.863138] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.certfile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.863278] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.collect_timing = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.863425] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.endpoint_type = public {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.863568] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.insecure = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.863707] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.keyfile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.863855] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.region_name = RegionOne {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864035] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.split_loggers = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864151] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] nova.timeout = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864294] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.auth_section = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864444] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.auth_type = password {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864590] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864730] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.certfile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.864869] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.collect_timing = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865020] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.endpoint_type = public {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865161] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.insecure = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865295] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.keyfile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865430] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.region_name = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865567] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.split_loggers = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865701] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] placement.timeout = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865847] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.auth_section = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.865990] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.auth_type = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.866139] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.cafile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.866274] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.certfile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.866416] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.collect_timing = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.866554] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.connect_retries = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.866712] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.connect_retry_delay = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.866866] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.enable_notifications = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867011] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.endpoint_override = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867158] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.insecure = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867296] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.interface = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867433] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.keyfile = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867569] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.max_version = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867707] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.min_version = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867842] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.region_name = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.867982] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.retriable_status_codes = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868131] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.service_name = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868267] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.service_type = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868410] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.split_loggers = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868547] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.status_code_retries = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868682] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.status_code_retry_delay = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868848] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.timeout = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.868994] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.valid_interfaces = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.869137] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ironic.version = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.869285] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] cli_script.dry_run = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.869436] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.869577] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.869743] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.869888] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870039] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870188] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870334] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870477] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870617] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870765] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.870905] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871070] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871219] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871363] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871505] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871652] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871796] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.871940] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872102] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872248] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872391] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872537] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872683] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872828] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.872974] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873133] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873271] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873415] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873549] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873695] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873840] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.ssl = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.873990] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.874150] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.874294] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.874442] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.874590] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.ssl_version = {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.874735] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.874888] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_notifications.driver = [] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.875045] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_notifications.retry = -1 {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.875202] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.875343] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] oslo_messaging_notifications.transport_url = **** {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.875453] env[68828]: DEBUG oslo_service.backend.eventlet.service [None req-dd72e1e5-7a20-4336-9c79-539e5930900f None None] ******************************************************************************** {{(pid=68828) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 530.876423] env[68828]: DEBUG neutron.agent.securitygroups_rpc [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Init firewall settings (driver=nsxv3) {{(pid=68828) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 530.877712] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=68828) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 530.877950] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] RPC agent_id: nsxm-l-01a.corp.local [ 530.880174] env[68828]: DEBUG dogpile.cache.region [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 530.880318] env[68828]: DEBUG dogpile.lock [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 530.880466] env[68828]: DEBUG dogpile.lock [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 530.880466] env[68828]: DEBUG dogpile.lock [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 530.880618] env[68828]: DEBUG dogpile.cache.region [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 530.880649] env[68828]: DEBUG dogpile.lock [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 530.880801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 530.913726] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Session token - acquiring [ 530.915082] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.915252] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.915354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.915782] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.926086] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 531.182404] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 531.206562] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 531.206728] env[68828]: DEBUG dogpile.cache.region [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Cache value generated in 0.326 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 531.206859] env[68828]: DEBUG dogpile.lock [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 531.206986] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Activating Policy API Provider. [ 531.207205] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Looking for the default Infrastructure Rules. [ 531.284181] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Looking for the Default Layer3 Logged Drop Section. [ 531.298836] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 531.299293] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.299462] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.299566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 531.299843] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 531.300194] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.814293] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 532.317193] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 532.819996] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Inventory metadata is going to be refreshed. [ 532.820202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 533.615326] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.615761] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.615761] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.615926] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.627396] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 533.728229] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.729182] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 533.749513] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.749722] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.749791] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.750140] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.750270] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.750421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 533.750540] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.750648] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 533.770523] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.770744] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.770790] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.771060] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.771239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.771386] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 533.789480] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.789701] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.789747] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.790076] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.790229] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.790375] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 533.806663] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.806860] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.806934] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.807283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.807406] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.807554] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 533.807661] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.807766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 533.823531] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.823727] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.823808] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.824112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.824246] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.824390] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 533.824496] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.824604] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 533.848153] env[68828]: DEBUG networking_nsxv3.common.locking [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.848326] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.848413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.848688] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.848897] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.849068] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 533.849178] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.849281] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Inventory metadata have been refreshed. [ 533.849381] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Dryrun:True. Metadata refresh completed. [ 533.849500] env[68828]: DEBUG oslo_concurrency.lockutils [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.851371] env[68828]: INFO neutron.agent.agent_extensions_manager [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Loaded agent extensions: [] [ 533.852266] env[68828]: DEBUG neutron_lib.callbacks.manager [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=68828) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 533.909011] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent RPC Daemon Started! [ 533.909194] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:0 started [ 533.909255] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent out of sync with plugin! [ 538.853094] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.853094] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.853604] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.853843] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 544.854746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.855163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.855163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.855325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.855510] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.357611] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.860476] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.362527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 546.362691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 547.070465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.070856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.070856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.070979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.082669] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 547.083480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.084095] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 547.099659] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.099797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.099851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.100062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.100152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.100262] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 547.100332] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.100403] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 547.117354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.117481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.117575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.117718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.117844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.117946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.134719] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.134880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.135866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.135866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.135866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.135866] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.151495] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.151716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.151716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.151859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.151957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.152078] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 547.152153] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.152222] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 547.168384] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.168522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.168522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.168697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.168776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.168875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 547.168946] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.169083] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 547.184833] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.184977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.185045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.185188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.185284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.185389] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 547.185458] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.185525] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 547.185579] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 547.185653] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 547.185719] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 547.185779] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 547.186066] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 547.186143] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 547.186200] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.201627] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.201762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.201801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.201956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.202063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.202162] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.216923] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.217117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.217179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.217340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.217431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.252137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.557080] env[68828]: INFO networking_nsxv3.common.synchronization [None req-214cfbbf-b897-4726-865f-fdb330ea4037 demo admin] Enqueued Resource ID: a338e8f9-2eba-43dd-817f-83e2a234d46b with Priority: HIGHEST for action security_group_rules [ 547.557134] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a338e8f9-2eba-43dd-817f-83e2a234d46b with Priority: HIGHEST for action security_group_rules [ 547.557574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a338e8f9-2eba-43dd-817f-83e2a234d46b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.557689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a338e8f9-2eba-43dd-817f-83e2a234d46b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.557762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a338e8f9-2eba-43dd-817f-83e2a234d46b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.558013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a338e8f9-2eba-43dd-817f-83e2a234d46b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.558231] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a338e8f9-2eba-43dd-817f-83e2a234d46b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.083599] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.083599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.083599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.083599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.083599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.083599] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a338e8f9-2eba-43dd-817f-83e2a234d46b already deleted. [ 548.083599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a338e8f9-2eba-43dd-817f-83e2a234d46b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.558245] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.558544] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.559217] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.560017] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.560999] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.561392] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.561741] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.562196] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.563119] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 572.563383] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 576.409198] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b1151b8e-6c42-4ac3-add5-460486d198bd None None] Enqueued Resource ID: 28395c2d-0eff-4285-a142-264e1b87674a with Priority: HIGHEST for action port [ 576.409198] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28395c2d-0eff-4285-a142-264e1b87674a with Priority: HIGHEST for action port [ 576.409198] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-28395c2d-0eff-4285-a142-264e1b87674a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.409198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28395c2d-0eff-4285-a142-264e1b87674a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.409198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28395c2d-0eff-4285-a142-264e1b87674a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.409198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28395c2d-0eff-4285-a142-264e1b87674a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.409198] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28395c2d-0eff-4285-a142-264e1b87674a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.913652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28395c2d-0eff-4285-a142-264e1b87674a [ 576.913808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.913944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.914064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.914235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.914326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.914422] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28395c2d-0eff-4285-a142-264e1b87674a already deleted. [ 576.914505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28395c2d-0eff-4285-a142-264e1b87674a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.847856] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9cc73652-c9ae-4971-b930-57c11bb34de4 None None] Enqueued Resource ID: 87e802ea-2748-446e-95af-87c76feb2925 with Priority: HIGHEST for action port [ 577.848167] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87e802ea-2748-446e-95af-87c76feb2925 with Priority: HIGHEST for action port [ 577.848523] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-87e802ea-2748-446e-95af-87c76feb2925 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.848643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87e802ea-2748-446e-95af-87c76feb2925" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.848856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87e802ea-2748-446e-95af-87c76feb2925" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.848943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87e802ea-2748-446e-95af-87c76feb2925" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.849671] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e802ea-2748-446e-95af-87c76feb2925',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.345552] env[68828]: INFO networking_nsxv3.common.synchronization [None req-16db71c9-25e3-4abb-bc13-21cc83758b44 None None] Enqueued Resource ID: 2709eeea-e7fb-4059-a50e-34672f8d0604 with Priority: HIGHEST for action port [ 578.345552] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2709eeea-e7fb-4059-a50e-34672f8d0604 with Priority: HIGHEST for action port [ 578.345883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2709eeea-e7fb-4059-a50e-34672f8d0604 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.345942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2709eeea-e7fb-4059-a50e-34672f8d0604" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.345979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2709eeea-e7fb-4059-a50e-34672f8d0604" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.346285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2709eeea-e7fb-4059-a50e-34672f8d0604" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.346395] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2709eeea-e7fb-4059-a50e-34672f8d0604',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.352308] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87e802ea-2748-446e-95af-87c76feb2925 [ 578.354266] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.354266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.354266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.354266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.354527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.354527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87e802ea-2748-446e-95af-87c76feb2925 already deleted. [ 578.354527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87e802ea-2748-446e-95af-87c76feb2925" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.849279] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2709eeea-e7fb-4059-a50e-34672f8d0604 [ 578.849832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.849832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.849832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.850631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.850631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.850631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2709eeea-e7fb-4059-a50e-34672f8d0604 already deleted. [ 578.850631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2709eeea-e7fb-4059-a50e-34672f8d0604" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.461619] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5b0d4390-3cdd-4faf-8d53-2d5dc4ea117f None None] Enqueued Resource ID: b03652fb-4865-47ed-9588-ae6c12f8eff3 with Priority: HIGHEST for action port [ 579.461861] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03652fb-4865-47ed-9588-ae6c12f8eff3 with Priority: HIGHEST for action port [ 579.462400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b03652fb-4865-47ed-9588-ae6c12f8eff3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.463049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b03652fb-4865-47ed-9588-ae6c12f8eff3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.463049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b03652fb-4865-47ed-9588-ae6c12f8eff3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.463049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b03652fb-4865-47ed-9588-ae6c12f8eff3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.463049] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b03652fb-4865-47ed-9588-ae6c12f8eff3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.934273] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6bfd094a-8b35-4fab-9c72-70d45e91184c None None] Enqueued Resource ID: 2077c863-4cfc-4e37-99ac-8c33c81c29a9 with Priority: HIGHEST for action port [ 579.934497] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2077c863-4cfc-4e37-99ac-8c33c81c29a9 with Priority: HIGHEST for action port [ 579.935765] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2077c863-4cfc-4e37-99ac-8c33c81c29a9 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.935765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2077c863-4cfc-4e37-99ac-8c33c81c29a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.935765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2077c863-4cfc-4e37-99ac-8c33c81c29a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.936486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2077c863-4cfc-4e37-99ac-8c33c81c29a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.936616] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2077c863-4cfc-4e37-99ac-8c33c81c29a9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.965223] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b03652fb-4865-47ed-9588-ae6c12f8eff3 [ 579.965549] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.965715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.966320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.967157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.967157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.967157] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b03652fb-4865-47ed-9588-ae6c12f8eff3 already deleted. [ 579.967157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b03652fb-4865-47ed-9588-ae6c12f8eff3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.283515] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9b532dec-7b52-4a78-925d-18a932171f35 None None] Enqueued Resource ID: a61af6a7-85d2-4403-a76c-ad54f6606cf6 with Priority: HIGHEST for action port [ 580.283795] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61af6a7-85d2-4403-a76c-ad54f6606cf6 with Priority: HIGHEST for action port [ 580.284611] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-a61af6a7-85d2-4403-a76c-ad54f6606cf6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.284736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a61af6a7-85d2-4403-a76c-ad54f6606cf6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.284798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a61af6a7-85d2-4403-a76c-ad54f6606cf6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.287234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a61af6a7-85d2-4403-a76c-ad54f6606cf6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.287367] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a61af6a7-85d2-4403-a76c-ad54f6606cf6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.416129] env[68828]: INFO networking_nsxv3.common.synchronization [None req-3133eff2-a70c-458d-8c00-82a4c7bce295 None None] Enqueued Resource ID: 72063041-d6fc-410e-8751-46f04269738c with Priority: HIGHEST for action port [ 580.417407] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72063041-d6fc-410e-8751-46f04269738c with Priority: HIGHEST for action port [ 580.417720] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-72063041-d6fc-410e-8751-46f04269738c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.417839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72063041-d6fc-410e-8751-46f04269738c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.417904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72063041-d6fc-410e-8751-46f04269738c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.419385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72063041-d6fc-410e-8751-46f04269738c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.419482] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72063041-d6fc-410e-8751-46f04269738c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.440569] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2077c863-4cfc-4e37-99ac-8c33c81c29a9 [ 580.440569] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.440569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.440569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.440569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.441706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.441706] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2077c863-4cfc-4e37-99ac-8c33c81c29a9 already deleted. [ 580.441706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2077c863-4cfc-4e37-99ac-8c33c81c29a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.791628] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a61af6a7-85d2-4403-a76c-ad54f6606cf6 [ 580.791628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.791628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.791628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.791628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.791628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.791628] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a61af6a7-85d2-4403-a76c-ad54f6606cf6 already deleted. [ 580.791628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a61af6a7-85d2-4403-a76c-ad54f6606cf6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.922248] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72063041-d6fc-410e-8751-46f04269738c [ 580.922601] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.922853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.923025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.923335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.923525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.923772] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72063041-d6fc-410e-8751-46f04269738c already deleted. [ 580.923952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72063041-d6fc-410e-8751-46f04269738c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.959121] env[68828]: INFO networking_nsxv3.common.synchronization [None req-1f5bdffb-a514-4d11-82d2-e5b327398bd3 None None] Enqueued Resource ID: 8577ca36-e291-4733-aef2-700f1aa00fa5 with Priority: HIGHEST for action port [ 580.959975] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8577ca36-e291-4733-aef2-700f1aa00fa5 with Priority: HIGHEST for action port [ 580.960954] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8577ca36-e291-4733-aef2-700f1aa00fa5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.962570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8577ca36-e291-4733-aef2-700f1aa00fa5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.962733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8577ca36-e291-4733-aef2-700f1aa00fa5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.963161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8577ca36-e291-4733-aef2-700f1aa00fa5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.963333] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8577ca36-e291-4733-aef2-700f1aa00fa5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.046898] env[68828]: INFO networking_nsxv3.common.synchronization [None req-cf672d9f-4c10-41bf-8784-a8ba519f6696 None None] Enqueued Resource ID: e561cb32-58c9-4b14-b2d8-c056ebc3b089 with Priority: HIGHEST for action port [ 581.046898] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e561cb32-58c9-4b14-b2d8-c056ebc3b089 with Priority: HIGHEST for action port [ 581.046898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e561cb32-58c9-4b14-b2d8-c056ebc3b089 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.046898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e561cb32-58c9-4b14-b2d8-c056ebc3b089" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.046898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e561cb32-58c9-4b14-b2d8-c056ebc3b089" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.046898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e561cb32-58c9-4b14-b2d8-c056ebc3b089" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.049148] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e561cb32-58c9-4b14-b2d8-c056ebc3b089',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.468418] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8577ca36-e291-4733-aef2-700f1aa00fa5 [ 581.468418] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.468418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.468418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.468418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.468418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.468418] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8577ca36-e291-4733-aef2-700f1aa00fa5 already deleted. [ 581.468418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8577ca36-e291-4733-aef2-700f1aa00fa5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.552523] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e561cb32-58c9-4b14-b2d8-c056ebc3b089 [ 581.552523] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.552523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.552872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.552872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.552872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.553050] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e561cb32-58c9-4b14-b2d8-c056ebc3b089 already deleted. [ 581.553050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e561cb32-58c9-4b14-b2d8-c056ebc3b089" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.073131] env[68828]: INFO networking_nsxv3.common.synchronization [None req-bed130f2-8cbf-4b14-b0fb-df7d806d52b3 None None] Enqueued Resource ID: 3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37 with Priority: HIGHEST for action port [ 582.073131] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37 with Priority: HIGHEST for action port [ 582.073131] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.074989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.075077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.075560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.075643] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.349571] env[68828]: INFO networking_nsxv3.common.synchronization [None req-8dcb4470-638e-4597-9a0d-3ced15000564 None None] Enqueued Resource ID: f097d273-8837-4655-bd39-5c94cc3743e0 with Priority: HIGHEST for action port [ 582.349828] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f097d273-8837-4655-bd39-5c94cc3743e0 with Priority: HIGHEST for action port [ 582.350394] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f097d273-8837-4655-bd39-5c94cc3743e0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.350564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f097d273-8837-4655-bd39-5c94cc3743e0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.351715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f097d273-8837-4655-bd39-5c94cc3743e0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.351715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f097d273-8837-4655-bd39-5c94cc3743e0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.351715] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f097d273-8837-4655-bd39-5c94cc3743e0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.579507] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37 [ 582.579507] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.579507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.579507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.579507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.579507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.579507] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37 already deleted. [ 582.579507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c1d4f77-6ac5-43e3-bc8a-0fe4bf259a37" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.854659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f097d273-8837-4655-bd39-5c94cc3743e0 [ 582.854659] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.854659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.854659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.854659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.854659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.854659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f097d273-8837-4655-bd39-5c94cc3743e0 already deleted. [ 582.854659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f097d273-8837-4655-bd39-5c94cc3743e0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.864483] env[68828]: INFO networking_nsxv3.common.synchronization [None req-191680df-0fb3-441f-87c1-080da8cc04b3 None None] Enqueued Resource ID: 1942da4f-c76b-409e-9705-ac5a3923b31a with Priority: HIGHEST for action port [ 583.865360] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1942da4f-c76b-409e-9705-ac5a3923b31a with Priority: HIGHEST for action port [ 583.866077] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1942da4f-c76b-409e-9705-ac5a3923b31a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.866077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1942da4f-c76b-409e-9705-ac5a3923b31a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.866077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1942da4f-c76b-409e-9705-ac5a3923b31a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.866284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1942da4f-c76b-409e-9705-ac5a3923b31a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.866326] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1942da4f-c76b-409e-9705-ac5a3923b31a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.373523] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1942da4f-c76b-409e-9705-ac5a3923b31a [ 584.373762] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.373862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.373932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.374275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.374275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.374740] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1942da4f-c76b-409e-9705-ac5a3923b31a already deleted. [ 584.374740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1942da4f-c76b-409e-9705-ac5a3923b31a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.489134] env[68828]: INFO networking_nsxv3.common.synchronization [req-3eb545b8-e3eb-4090-a92e-3c5798c74362 req-bb215cb1-5cd8-421b-a10c-492f08206541 tempest-DeleteServersAdminTestJSON-483334800 tempest-DeleteServersAdminTestJSON-483334800-project-member] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 584.490330] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 584.490330] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.490330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.490330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.491019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.491019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.491019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.491019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.491209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.492375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.492375] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.993565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.993848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.993848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.998019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.998019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d already deleted. [ 584.998019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.535304] env[68828]: INFO networking_nsxv3.common.synchronization [None req-34ed701a-a983-408b-bb90-ad3a3c0d829c None None] Enqueued Resource ID: 92df594e-6b42-4a91-a34d-7741f5170b92 with Priority: HIGHEST for action port [ 585.535890] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df594e-6b42-4a91-a34d-7741f5170b92 with Priority: HIGHEST for action port [ 585.536401] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-92df594e-6b42-4a91-a34d-7741f5170b92 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.536783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92df594e-6b42-4a91-a34d-7741f5170b92" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.536902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92df594e-6b42-4a91-a34d-7741f5170b92" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.537283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92df594e-6b42-4a91-a34d-7741f5170b92" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.537389] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92df594e-6b42-4a91-a34d-7741f5170b92',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.568908] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.569174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.569267] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.571743] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.575422] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.575422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.575422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.575422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.575422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.575422] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.575422] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.575422] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.575422] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.575422] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.576479] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.576885] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.602669] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.605028] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 585.605104] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.605290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.605596] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.605773] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.605892] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.606225] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.606446] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.619595] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5c5bea24-eea5-4593-8820-9575d9d4e479 None None] Enqueued Resource ID: 3499e177-5060-41a2-a575-de8e48e887eb with Priority: HIGHEST for action port [ 585.621035] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3499e177-5060-41a2-a575-de8e48e887eb with Priority: HIGHEST for action port [ 585.621395] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-3499e177-5060-41a2-a575-de8e48e887eb taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.621536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3499e177-5060-41a2-a575-de8e48e887eb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.621651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3499e177-5060-41a2-a575-de8e48e887eb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.621955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3499e177-5060-41a2-a575-de8e48e887eb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.621993] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3499e177-5060-41a2-a575-de8e48e887eb',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.938087] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a6c79732-1bc8-4bd9-9fee-2f8ce7c6405c None None] Enqueued Resource ID: ecdc98ce-91ac-4a96-9aa1-3f42df640a80 with Priority: HIGHEST for action port [ 585.941118] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdc98ce-91ac-4a96-9aa1-3f42df640a80 with Priority: HIGHEST for action port [ 585.941118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecdc98ce-91ac-4a96-9aa1-3f42df640a80 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.941118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecdc98ce-91ac-4a96-9aa1-3f42df640a80" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.941118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecdc98ce-91ac-4a96-9aa1-3f42df640a80" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.941118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecdc98ce-91ac-4a96-9aa1-3f42df640a80" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.941118] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecdc98ce-91ac-4a96-9aa1-3f42df640a80',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.039493] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92df594e-6b42-4a91-a34d-7741f5170b92 [ 586.039882] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.039958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.040111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.040351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.041165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.041258] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92df594e-6b42-4a91-a34d-7741f5170b92 already deleted. [ 586.041315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92df594e-6b42-4a91-a34d-7741f5170b92" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.112022] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.112022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 not found, creating... [ 586.112022] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.112022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.112514] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.112891] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.113243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.113537] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.113801] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.114054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 is going to be created. [ 586.125785] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3499e177-5060-41a2-a575-de8e48e887eb [ 586.125867] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.125993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.126076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.126282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.126371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.126467] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3499e177-5060-41a2-a575-de8e48e887eb already deleted. [ 586.126552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3499e177-5060-41a2-a575-de8e48e887eb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.157813] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.158020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.158020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.158251] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.158481] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.158709] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.271724] env[68828]: INFO networking_nsxv3.common.synchronization [req-6f6502c8-3bff-459f-9bd8-eb42186911d0 req-a3f104a6-bfd3-48c9-9c3f-64c01cd992cb tempest-ServerDiagnosticsNegativeTest-376201189 tempest-ServerDiagnosticsNegativeTest-376201189-project-member] Enqueued Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_members [ 586.273439] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_members [ 586.273840] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.274163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.274410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.274772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.275048] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.275277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.275425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.276841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.276841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.276841] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.444575] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecdc98ce-91ac-4a96-9aa1-3f42df640a80 [ 586.444575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.444575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.444575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.444575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.444575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.444575] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecdc98ce-91ac-4a96-9aa1-3f42df640a80 already deleted. [ 586.444575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecdc98ce-91ac-4a96-9aa1-3f42df640a80" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.628697] env[68828]: INFO networking_nsxv3.common.synchronization [None req-57438eeb-21ad-4d3a-87e8-5a0f4c702eb9 None None] Enqueued Resource ID: 4a7139c9-cfb8-498b-97a7-405ba21ece0c with Priority: HIGHEST for action port [ 586.628854] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7139c9-cfb8-498b-97a7-405ba21ece0c with Priority: HIGHEST for action port [ 586.629403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7139c9-cfb8-498b-97a7-405ba21ece0c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.629599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7139c9-cfb8-498b-97a7-405ba21ece0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.629599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7139c9-cfb8-498b-97a7-405ba21ece0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.629850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7139c9-cfb8-498b-97a7-405ba21ece0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.629923] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7139c9-cfb8-498b-97a7-405ba21ece0c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.780451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.780583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.780625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.780852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.780941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.781175] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.781299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.782090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.782090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.782090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.782090] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb85f31-5e65-47cb-bc60-aada80785442 already deleted. [ 586.782090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.136360] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a7139c9-cfb8-498b-97a7-405ba21ece0c [ 587.136628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.136744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.136813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.137040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.137129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.137223] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a7139c9-cfb8-498b-97a7-405ba21ece0c already deleted. [ 587.137300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7139c9-cfb8-498b-97a7-405ba21ece0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.343097] env[68828]: INFO networking_nsxv3.common.synchronization [None req-23ff239a-39a5-4de4-ae00-3b111ef03a86 tempest-VolumesAdminNegativeTest-51626435 tempest-VolumesAdminNegativeTest-51626435-project-member] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_rules [ 587.343456] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_rules [ 587.343748] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.343866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.343932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.344654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.344691] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.418585] env[68828]: INFO networking_nsxv3.common.synchronization [None req-15440ed3-496b-4a55-adb8-a145efd5cf94 None None] Enqueued Resource ID: 7d37679b-af02-4b4b-953d-79cc6670123b with Priority: HIGHEST for action port [ 587.418827] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d37679b-af02-4b4b-953d-79cc6670123b with Priority: HIGHEST for action port [ 587.419382] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d37679b-af02-4b4b-953d-79cc6670123b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.419511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d37679b-af02-4b4b-953d-79cc6670123b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.419597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d37679b-af02-4b4b-953d-79cc6670123b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.419942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d37679b-af02-4b4b-953d-79cc6670123b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.420048] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d37679b-af02-4b4b-953d-79cc6670123b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.863602] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.863743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.863812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.864022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.864202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.864202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 already deleted. [ 587.865111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.921562] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d9847445-bcf7-4f53-937b-1effd0201c5f tempest-VolumesAdminNegativeTest-51626435 tempest-VolumesAdminNegativeTest-51626435-project-member] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_rules [ 587.921562] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_rules [ 587.921562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.921562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.921562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.921562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.921562] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.921929] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d37679b-af02-4b4b-953d-79cc6670123b [ 587.922188] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.922285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.922404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.922622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.922745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.922862] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d37679b-af02-4b4b-953d-79cc6670123b already deleted. [ 587.922972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d37679b-af02-4b4b-953d-79cc6670123b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.989992] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.989992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.989992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.989992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.989992] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.993649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.993649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.993649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.993649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.994267] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.994455] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.995538] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.995538] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.995538] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.995538] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.995538] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.012575] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.012695] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 588.013065] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.013065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.013319] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-e4f35675-f1c8-4e27-bec8-a40e294146d4 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.014065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.014065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.014065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.014065] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4f35675-f1c8-4e27-bec8-a40e294146d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.098667] env[68828]: INFO networking_nsxv3.common.synchronization [None req-965083ca-573b-48b2-8beb-fdbe06c8ff34 None None] Enqueued Resource ID: 9d161d6a-b826-4f28-8f54-ea01905661ef with Priority: HIGHEST for action port [ 588.100231] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d161d6a-b826-4f28-8f54-ea01905661ef with Priority: HIGHEST for action port [ 588.103145] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d161d6a-b826-4f28-8f54-ea01905661ef taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.103145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d161d6a-b826-4f28-8f54-ea01905661ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.103145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d161d6a-b826-4f28-8f54-ea01905661ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.103145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d161d6a-b826-4f28-8f54-ea01905661ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.103145] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d161d6a-b826-4f28-8f54-ea01905661ef',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.218203] env[68828]: INFO networking_nsxv3.common.synchronization [req-3eb545b8-e3eb-4090-a92e-3c5798c74362 req-d1775925-1392-41b6-a3eb-cd545acdd9e8 service nova] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_rules [ 588.218203] env[68828]: INFO networking_nsxv3.common.synchronization [req-3eb545b8-e3eb-4090-a92e-3c5798c74362 req-d1775925-1392-41b6-a3eb-cd545acdd9e8 service nova] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 588.218203] env[68828]: INFO networking_nsxv3.common.synchronization [req-3eb545b8-e3eb-4090-a92e-3c5798c74362 req-d1775925-1392-41b6-a3eb-cd545acdd9e8 service nova] Enqueued Resource ID: 8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 with Priority: HIGHEST for action port [ 588.218203] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_rules [ 588.218203] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 588.218203] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 with Priority: HIGHEST for action port [ 588.226023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.226023] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.226023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.226023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.226023] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.226023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.226023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.226919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.226919] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.297889] env[68828]: INFO networking_nsxv3.common.synchronization [req-12462f7c-a41f-4ae2-9728-f30738dd4c6e req-25aa6ca5-edba-47ee-9c41-a1ad671a1042 tempest-TenantUsagesTestJSON-1368908414 tempest-TenantUsagesTestJSON-1368908414-project-member] Enqueued Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_members [ 588.298208] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_members [ 588.298517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.298684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.298772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.299056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.299231] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.299355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.299413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.299720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.299757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.300736] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.450494] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.450693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.450748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.450952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.451060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.451166] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 already deleted. [ 588.451250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.518578] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.521025] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port e4f35675-f1c8-4e27-bec8-a40e294146d4 not found, creating... [ 588.521025] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.521025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.521938] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.522694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.524811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.524811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.524811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.524811] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: e4f35675-f1c8-4e27-bec8-a40e294146d4 is going to be created. [ 588.542819] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.543044] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.543170] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.543429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.544624] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.545382] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.563379] env[68828]: INFO networking_nsxv3.common.synchronization [None req-981d1809-e1eb-4fca-9773-c12d674a951b None None] Enqueued Resource ID: 554d5b77-5910-44d2-9a79-c45f213e716e with Priority: HIGHEST for action port [ 588.563976] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 554d5b77-5910-44d2-9a79-c45f213e716e with Priority: HIGHEST for action port [ 588.565320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-554d5b77-5910-44d2-9a79-c45f213e716e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.565320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-554d5b77-5910-44d2-9a79-c45f213e716e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.565320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-554d5b77-5910-44d2-9a79-c45f213e716e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.565320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-554d5b77-5910-44d2-9a79-c45f213e716e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.565320] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554d5b77-5910-44d2-9a79-c45f213e716e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.604432] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d161d6a-b826-4f28-8f54-ea01905661ef [ 588.605302] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.605406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.605406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.605590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.605695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.605792] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d161d6a-b826-4f28-8f54-ea01905661ef already deleted. [ 588.605855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d161d6a-b826-4f28-8f54-ea01905661ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.726312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.726437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.735815] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 with status ACTIVE [ 588.735815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.735965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.736140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.736542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.736542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.736945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.736945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.736945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.736945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.737099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.738926] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.739211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.739211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.739289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.739423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.739468] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75 is going to be updated. [ 588.747387] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.766696] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.766696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.766696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.766696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.766696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.766696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8790cd5b-b7dd-40d1-aef3-d5ae6f69eb75" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.802959] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.803228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.803228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.803444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.803687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.803757] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.803880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.803916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.804078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.804177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.804264] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c55eb713-452e-4803-84ae-58a048b5a359 already deleted. [ 588.804618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.031732] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.032170] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.032300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.032562] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.032827] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.033741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.033741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.033741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.033741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.033741] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.033741] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.033986] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.033986] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.034066] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.034170] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.034299] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.051573] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.051745] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 589.051867] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.052101] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.052553] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.052638] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.052968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.053064] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.053547] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.066918] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 554d5b77-5910-44d2-9a79-c45f213e716e [ 589.067151] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.067281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.067348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.067588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.067689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.067782] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:554d5b77-5910-44d2-9a79-c45f213e716e already deleted. [ 589.067858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-554d5b77-5910-44d2-9a79-c45f213e716e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.206765] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9c896209-3ba9-482e-aa63-98e97a8bce2c None None] Enqueued Resource ID: 49a10f02-473c-4091-95c2-ad89af0ea14e with Priority: HIGHEST for action port [ 589.207040] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49a10f02-473c-4091-95c2-ad89af0ea14e with Priority: HIGHEST for action port [ 589.207707] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-49a10f02-473c-4091-95c2-ad89af0ea14e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.207867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49a10f02-473c-4091-95c2-ad89af0ea14e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.207957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49a10f02-473c-4091-95c2-ad89af0ea14e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.208301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49a10f02-473c-4091-95c2-ad89af0ea14e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.208386] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49a10f02-473c-4091-95c2-ad89af0ea14e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.248166] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.556541] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.556882] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.556882] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.557167] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.558050] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.558532] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b not found, creating... [ 589.559827] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.561012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.561012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.561012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.561012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.561012] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.561252] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.561287] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.561509] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.561743] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.561807] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b is going to be created. [ 589.587891] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.588123] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.588248] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.588517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.588740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.588956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.711617] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49a10f02-473c-4091-95c2-ad89af0ea14e [ 589.712208] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.712981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.717955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.717955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.717955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.717955] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49a10f02-473c-4091-95c2-ad89af0ea14e already deleted. [ 589.717955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49a10f02-473c-4091-95c2-ad89af0ea14e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.749968] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.752874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.752874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.752874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.752874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.753407] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be created. [ 589.756344] env[68828]: INFO networking_nsxv3.common.synchronization [req-6f6502c8-3bff-459f-9bd8-eb42186911d0 req-46739c39-bdc7-4401-8336-63613c4495b1 service nova] Enqueued Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_rules [ 589.758241] env[68828]: INFO networking_nsxv3.common.synchronization [req-6f6502c8-3bff-459f-9bd8-eb42186911d0 req-46739c39-bdc7-4401-8336-63613c4495b1 service nova] Enqueued Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_members [ 589.758876] env[68828]: INFO networking_nsxv3.common.synchronization [req-6f6502c8-3bff-459f-9bd8-eb42186911d0 req-46739c39-bdc7-4401-8336-63613c4495b1 service nova] Enqueued Resource ID: e4f35675-f1c8-4e27-bec8-a40e294146d4 with Priority: HIGHEST for action port [ 589.759536] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_rules [ 589.759758] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_members [ 589.760300] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4f35675-f1c8-4e27-bec8-a40e294146d4 with Priority: HIGHEST for action port [ 589.761090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.761267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.761890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.762599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.762599] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.763307] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.763307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.763431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.763654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.763867] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.764017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.764121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.765188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.765188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.765188] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.765368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4f35675-f1c8-4e27-bec8-a40e294146d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.765527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.765593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.765785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.765927] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4f35675-f1c8-4e27-bec8-a40e294146d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.884082] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.884263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.884263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.884591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.884669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.897701] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: UNINITIALIZED for 2s [ 590.271674] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.275021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.275021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4f35675-f1c8-4e27-bec8-a40e294146d4 with status ACTIVE [ 590.275021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.275021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.275021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.275021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.275730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.275730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.275730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.275730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.275730] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4f35675-f1c8-4e27-bec8-a40e294146d4 is going to be updated. [ 590.299616] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.299616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.299616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.299616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.299616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.299616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4f35675-f1c8-4e27-bec8-a40e294146d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.476210] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c93e79a9-085e-4b49-afcb-01fce77a5b60 None None] Enqueued Resource ID: f2215909-6bb5-4147-b9a2-8bd339046201 with Priority: HIGHEST for action port [ 590.476210] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2215909-6bb5-4147-b9a2-8bd339046201 with Priority: HIGHEST for action port [ 590.476210] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2215909-6bb5-4147-b9a2-8bd339046201 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.476210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2215909-6bb5-4147-b9a2-8bd339046201" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.476210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2215909-6bb5-4147-b9a2-8bd339046201" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.479524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2215909-6bb5-4147-b9a2-8bd339046201" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.479645] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2215909-6bb5-4147-b9a2-8bd339046201',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.535766] env[68828]: INFO networking_nsxv3.common.synchronization [req-12462f7c-a41f-4ae2-9728-f30738dd4c6e req-1063f39e-7d80-4d29-9013-8035291fbc12 service nova] Enqueued Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_rules [ 590.535766] env[68828]: INFO networking_nsxv3.common.synchronization [req-12462f7c-a41f-4ae2-9728-f30738dd4c6e req-1063f39e-7d80-4d29-9013-8035291fbc12 service nova] Enqueued Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_members [ 590.535990] env[68828]: INFO networking_nsxv3.common.synchronization [req-12462f7c-a41f-4ae2-9728-f30738dd4c6e req-1063f39e-7d80-4d29-9013-8035291fbc12 service nova] Enqueued Resource ID: e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b with Priority: HIGHEST for action port [ 590.536497] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_rules [ 590.536631] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_members [ 590.536729] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b with Priority: HIGHEST for action port [ 590.536991] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.538185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.538263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.538538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.538591] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.539564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.539564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.539564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.540515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.540515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.540515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.540515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.540515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.540515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.540515] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.544567] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.544715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.544751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.544897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.544969] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.779620] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.985118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2215909-6bb5-4147-b9a2-8bd339046201 [ 590.985393] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.985529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.985604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.985802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.985884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.987671] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2215909-6bb5-4147-b9a2-8bd339046201 already deleted. [ 590.987671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2215909-6bb5-4147-b9a2-8bd339046201" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.048146] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.048285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.048506] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.049505] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b with status ACTIVE [ 591.049579] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.049696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.050208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.050444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.050542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.050730] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.050878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.050998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.051154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.051245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.051458] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.051557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.051632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.051937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.052038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.052706] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b is going to be updated. [ 591.074637] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.074637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.074637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.074857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.075063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.075155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2ea6fdb-a2c5-45ec-b53f-a0dc16d9c79b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.283093] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.283374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.283374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.283571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.283648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.283754] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb85f31-5e65-47cb-bc60-aada80785442 is going to be created. [ 591.306059] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.306220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.306293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.306516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.306744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.316114] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb85f31-5e65-47cb-bc60-aada80785442 in Status: UNINITIALIZED for 2s [ 591.389639] env[68828]: INFO networking_nsxv3.common.synchronization [req-46d78eba-3ae7-4535-ab09-4192ef256143 req-466f56d6-2847-4576-9363-abf8020d6e7e tempest-MigrationsAdminTest-1798027422 tempest-MigrationsAdminTest-1798027422-project-member] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 591.389639] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 591.389880] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.390981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.391165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.391398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.391577] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.391735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.391768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.393109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.393109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.393109] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.555050] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.893859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.894328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.894500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.894722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.894819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.895213] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.895213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.895213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.895504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.895504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.895565] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa already deleted. [ 591.895605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.911283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 591.911283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.911548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.911754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.911954] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.912145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.912145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.912302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.912524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.912524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.912524] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.058485] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.058485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.058485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.061404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.061486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.061611] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c55eb713-452e-4803-84ae-58a048b5a359 is going to be created. [ 592.087020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.087020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.087020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.087020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.087020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.094948] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c55eb713-452e-4803-84ae-58a048b5a359 in Status: UNINITIALIZED for 2s [ 592.266643] env[68828]: INFO networking_nsxv3.common.synchronization [req-7bd9452c-c2f9-4401-bc4e-465906fa2263 req-c669b3f6-f303-4a52-a775-926b04c31efc tempest-ServerAddressesTestJSON-808422504 tempest-ServerAddressesTestJSON-808422504-project-member] Enqueued Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_members [ 592.266643] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_members [ 592.266643] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.266643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.266643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.266643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.266893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.266893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.266893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.267019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.267543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.267543] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.380453] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ad2b51e0-e404-4c6e-aa7b-b5e5680371c2 None None] Enqueued Resource ID: dd946847-f7e2-41ff-9d03-72c88ccc9cdf with Priority: HIGHEST for action port [ 592.381287] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd946847-f7e2-41ff-9d03-72c88ccc9cdf with Priority: HIGHEST for action port [ 592.381507] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd946847-f7e2-41ff-9d03-72c88ccc9cdf taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.381678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd946847-f7e2-41ff-9d03-72c88ccc9cdf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.381767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd946847-f7e2-41ff-9d03-72c88ccc9cdf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.382860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd946847-f7e2-41ff-9d03-72c88ccc9cdf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.382860] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd946847-f7e2-41ff-9d03-72c88ccc9cdf',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.419739] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.419739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.419739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.419739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.419739] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.419739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.419739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.419739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.421314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.421314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.421314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.421314] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.596703] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7733ed6a-3296-47d4-8411-8bf8baca75f2 None None] Enqueued Resource ID: a6e00852-f880-4e43-97f2-bc48d808a40a with Priority: HIGHEST for action port [ 592.597302] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6e00852-f880-4e43-97f2-bc48d808a40a with Priority: HIGHEST for action port [ 592.597657] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6e00852-f880-4e43-97f2-bc48d808a40a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.597815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6e00852-f880-4e43-97f2-bc48d808a40a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.597901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6e00852-f880-4e43-97f2-bc48d808a40a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.599326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6e00852-f880-4e43-97f2-bc48d808a40a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.599326] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6e00852-f880-4e43-97f2-bc48d808a40a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.725989] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.725989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.726797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.726797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.726797] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.726971] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.730835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.731546] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.731953] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.732914] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 592.732914] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.732914] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.732914] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.733200] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 592.733200] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.734956] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.753825] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.754117] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 592.754313] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.754594] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.755223] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.755545] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.755802] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.756475] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.756880] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.770232] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.770831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.774339] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.774339] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b already deleted. [ 592.774339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.884510] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd946847-f7e2-41ff-9d03-72c88ccc9cdf [ 592.884751] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.884892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.884969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.885215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.885308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.885411] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd946847-f7e2-41ff-9d03-72c88ccc9cdf already deleted. [ 592.885676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd946847-f7e2-41ff-9d03-72c88ccc9cdf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.923547] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 185198c9-6b76-40ca-9634-3cee48a72a6d: rpc.has_security_group_logging(os_id): False [ 592.940272] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.940272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.940440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.941622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.941808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.942113] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.942225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.942295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.942463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.942538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.942723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.942820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.942881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.944581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.944682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.944903] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.944998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.945065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.945244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.945295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.945369] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be created. [ 593.024938] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.025082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.025158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.025400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.025669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.038964] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: IN_PROGRESS for 2s [ 593.104341] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6e00852-f880-4e43-97f2-bc48d808a40a [ 593.104555] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.104695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.104841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.105017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.105082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.105173] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6e00852-f880-4e43-97f2-bc48d808a40a already deleted. [ 593.105254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6e00852-f880-4e43-97f2-bc48d808a40a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.259177] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-544 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.259404] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-544" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.259508] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-544" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.259874] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-544" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.260166] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.260328] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.260443] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.260684] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.260936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.262100] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.262365] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.262451] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.262553] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.262675] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.262953] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.263152] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.264847] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.265061] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.265190] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.265429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.265575] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.265946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 not found, creating... [ 593.266484] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.266721] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.266992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.267174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.267461] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.267575] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.267801] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.267906] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.268170] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.268300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.268524] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 is going to be created. [ 593.289916] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.290134] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 593.290278] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.290460] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-544" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.290789] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.291067] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.291202] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.291410] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.291547] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2dce65-96b2-4d65-a902-ddf39d3d58f7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.295986] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.295986] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.295986] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.296244] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.296427] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.296666] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.330196] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb85f31-5e65-47cb-bc60-aada80785442 in Status: SUCCESS [ 593.330438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.330523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.330724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.330916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.331052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.331118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.331274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.331358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.331441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.331525] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.605137] env[68828]: INFO networking_nsxv3.common.synchronization [req-8f42484b-6bbe-4539-a926-9d1c152dcd24 req-d4e996b2-ad27-4061-afb2-4ecbdd45ac13 tempest-FloatingIPsAssociationTestJSON-1635333144 tempest-FloatingIPsAssociationTestJSON-1635333144-project-member] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 593.605137] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 593.606313] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.606495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.606604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.606965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.608834] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.608834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.608834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.608834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.608834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.608834] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.798989] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.798989] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ca2dce65-96b2-4d65-a902-ddf39d3d58f7 not found, creating... [ 593.798989] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.798989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.799490] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.799490] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.799490] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.799623] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.799806] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.800055] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ca2dce65-96b2-4d65-a902-ddf39d3d58f7 is going to be created. [ 593.824185] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.824464] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.824631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.824968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.825240] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.825825] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.834287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.834730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.834730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.834730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.834910] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.835015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.835280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.835483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.835549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.835617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.837070] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.838991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.839130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.839313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.839476] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.839576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.839653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.839825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.840115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.840115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.840598] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.067851] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-975 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.067997] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.068097] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.068674] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.068674] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.068828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.068913] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.069330] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.069766] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.069766] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.069891] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.069981] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.070113] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.070226] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.070342] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.070476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.088526] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.088701] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 594.088844] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.089038] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.089499] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.089594] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.089658] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.090011] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.090242] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.102662] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c55eb713-452e-4803-84ae-58a048b5a359 in Status: SUCCESS [ 594.102884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.103066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.103501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.103501] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.103634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.107562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.107562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.107810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.107810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.109531] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.111670] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.111824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.111824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.112303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.112303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.112303] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.112625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.112625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.112625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.112776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.112776] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 already deleted. [ 594.112835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.307075] env[68828]: INFO networking_nsxv3.common.synchronization [req-46d78eba-3ae7-4535-ab09-4192ef256143 req-fa970281-dd1a-496c-a077-6bc4b9d1598d service nova] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_rules [ 594.307479] env[68828]: INFO networking_nsxv3.common.synchronization [req-46d78eba-3ae7-4535-ab09-4192ef256143 req-fa970281-dd1a-496c-a077-6bc4b9d1598d service nova] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 594.307726] env[68828]: INFO networking_nsxv3.common.synchronization [req-46d78eba-3ae7-4535-ab09-4192ef256143 req-fa970281-dd1a-496c-a077-6bc4b9d1598d service nova] Enqueued Resource ID: 9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 with Priority: HIGHEST for action port [ 594.309023] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_rules [ 594.309023] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 594.309023] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 with Priority: HIGHEST for action port [ 594.309023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.309411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.309559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.309901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.313103] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.313103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.313103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.313103] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.313103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.313103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.314964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.315233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.315395] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.342794] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bb85f31-5e65-47cb-bc60-aada80785442: rpc.has_security_group_logging(os_id): False [ 594.359825] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.359985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.360093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.360324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.360373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.360534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.360721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.360721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.360857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.360986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.361237] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.361237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.361330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.361492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.361492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.361656] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.361770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.361807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.361930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.362046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.362137] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb85f31-5e65-47cb-bc60-aada80785442 is going to be created. [ 594.422130] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.422542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.422627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.422843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.423175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.433662] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb85f31-5e65-47cb-bc60-aada80785442 in Status: IN_PROGRESS for 2s [ 594.592916] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.593226] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.593382] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.593976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.594196] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.594388] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 not found, creating... [ 594.594727] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.594900] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.595065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.595558] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.595748] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.596357] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.596357] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.596357] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.596850] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.597458] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.597458] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 is going to be created. [ 594.613428] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.613724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.613724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.614179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.614179] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.614179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.614466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.614466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.614466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.614597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.614650] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.614747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.614801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.614942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.615088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.615205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.615253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.615356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.615612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.615612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.615612] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.617853] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.618037] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.618303] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.618393] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.618581] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.618786] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.756775] env[68828]: INFO networking_nsxv3.common.synchronization [req-7bd9452c-c2f9-4401-bc4e-465906fa2263 req-1b635542-042f-4ce1-a5d7-780d4bef49e2 service nova] Enqueued Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_rules [ 594.757140] env[68828]: INFO networking_nsxv3.common.synchronization [req-7bd9452c-c2f9-4401-bc4e-465906fa2263 req-1b635542-042f-4ce1-a5d7-780d4bef49e2 service nova] Enqueued Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_members [ 594.757466] env[68828]: INFO networking_nsxv3.common.synchronization [req-7bd9452c-c2f9-4401-bc4e-465906fa2263 req-1b635542-042f-4ce1-a5d7-780d4bef49e2 service nova] Enqueued Resource ID: ca2dce65-96b2-4d65-a902-ddf39d3d58f7 with Priority: HIGHEST for action port [ 594.758306] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_rules [ 594.758569] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_members [ 594.758783] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2dce65-96b2-4d65-a902-ddf39d3d58f7 with Priority: HIGHEST for action port [ 594.759166] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.759523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.760454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.761158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.761585] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.764557] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.764557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.764557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.766520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.766520] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.766520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.766520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.766520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.766520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.769379] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.770154] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.770271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.770333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.770524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.770620] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2dce65-96b2-4d65-a902-ddf39d3d58f7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.820209] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.820209] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.820209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.820383] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 with status ACTIVE [ 594.820610] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.820610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.820797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.820863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.821088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.821148] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.821202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.821269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.821395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.821467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.821640] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.821742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.821801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.821930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.822008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.822097] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9 is going to be updated. [ 594.842849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.842959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.843008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.843258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.843413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.845225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e3e2947-8fed-4a24-98fe-8bcfabd3a2a9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.050296] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 595.051317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.117464] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c55eb713-452e-4803-84ae-58a048b5a359: rpc.has_security_group_logging(os_id): False [ 595.137211] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.137496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.137496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.137777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.137777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.138144] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.138144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.138144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.138359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.138359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.138499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.139070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.139070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.139070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.139070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.139070] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.139322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.139322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.139322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.139406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.139406] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c55eb713-452e-4803-84ae-58a048b5a359 is going to be created. [ 595.198982] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.199147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.199197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.199404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.199575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.209191] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c55eb713-452e-4803-84ae-58a048b5a359 in Status: IN_PROGRESS for 2s [ 595.273985] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.274155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.274278] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.275145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca2dce65-96b2-4d65-a902-ddf39d3d58f7 with status ACTIVE [ 595.275320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.275428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.275492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.275696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.275781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.275937] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.276062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.276096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.276237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.276314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.277067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.278019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.278019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.278019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.278019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.278019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca2dce65-96b2-4d65-a902-ddf39d3d58f7 is going to be updated. [ 595.306203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.306358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.306426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.306640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.306770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.306928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca2dce65-96b2-4d65-a902-ddf39d3d58f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.325013] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.779999] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.831228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.831580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.831580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.831669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.831835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.831835] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be created. [ 595.858177] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.858177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.858177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.858379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.858908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.873160] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: UNINITIALIZED for 2s [ 595.997470] env[68828]: INFO networking_nsxv3.common.synchronization [req-8f42484b-6bbe-4539-a926-9d1c152dcd24 req-336a73d7-482c-45a8-97b1-f16fe39182a2 service nova] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_rules [ 595.997633] env[68828]: INFO networking_nsxv3.common.synchronization [req-8f42484b-6bbe-4539-a926-9d1c152dcd24 req-336a73d7-482c-45a8-97b1-f16fe39182a2 service nova] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 595.997782] env[68828]: INFO networking_nsxv3.common.synchronization [req-8f42484b-6bbe-4539-a926-9d1c152dcd24 req-336a73d7-482c-45a8-97b1-f16fe39182a2 service nova] Enqueued Resource ID: ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 with Priority: HIGHEST for action port [ 595.998820] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_rules [ 595.999220] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 595.999220] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 with Priority: HIGHEST for action port [ 596.001411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.001411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.001411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.001411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.001411] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.001411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.001411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.001411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.002333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.002333] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.002333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.002333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.002333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.002333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.002333] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.003455] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.003455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.003590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.003757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.003856] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.214037] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d02e1837-6c2e-444a-a9dc-a02182755ab2 None None] Enqueued Resource ID: 86416362-3a09-4235-8324-81c047488af4 with Priority: HIGHEST for action port [ 596.214037] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86416362-3a09-4235-8324-81c047488af4 with Priority: HIGHEST for action port [ 596.214037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-86416362-3a09-4235-8324-81c047488af4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.214037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86416362-3a09-4235-8324-81c047488af4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.215236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86416362-3a09-4235-8324-81c047488af4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.215574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86416362-3a09-4235-8324-81c047488af4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.215640] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86416362-3a09-4235-8324-81c047488af4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.285526] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.285740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.285811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.286834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.288378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.288378] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b is going to be created. [ 596.313067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.313067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.313067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.313067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.313067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.325508] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b in Status: UNINITIALIZED for 2s [ 596.402609] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6deaf51a-4a48-473b-b85f-9d852a336cd1 None None] Enqueued Resource ID: b60cc8cb-5d19-4d3c-a5d5-1e04874034f1 with Priority: HIGHEST for action port [ 596.402609] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60cc8cb-5d19-4d3c-a5d5-1e04874034f1 with Priority: HIGHEST for action port [ 596.402609] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60cc8cb-5d19-4d3c-a5d5-1e04874034f1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.402609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60cc8cb-5d19-4d3c-a5d5-1e04874034f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.402609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60cc8cb-5d19-4d3c-a5d5-1e04874034f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.402609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60cc8cb-5d19-4d3c-a5d5-1e04874034f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.402609] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60cc8cb-5d19-4d3c-a5d5-1e04874034f1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.445924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bb85f31-5e65-47cb-bc60-aada80785442 in Status: SUCCESS [ 596.446168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.506466] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.506466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.506659] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.507637] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 with status ACTIVE [ 596.507837] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.508068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.508068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.508340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.508340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.508533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.508585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.508650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.508867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.508867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.509265] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.509659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.509659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.509659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.509659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.509659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3 is going to be updated. [ 596.530352] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.530352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.530352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.530352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.530352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.530856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae21e9f0-73ff-40d5-bf8a-f3a4181bcdd3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.719379] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86416362-3a09-4235-8324-81c047488af4 [ 596.719379] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.719379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.719379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.719379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.719379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.719379] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86416362-3a09-4235-8324-81c047488af4 already deleted. [ 596.719379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86416362-3a09-4235-8324-81c047488af4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.906421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b60cc8cb-5d19-4d3c-a5d5-1e04874034f1 [ 596.906794] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.906794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.906968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.907154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.907244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.907338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b60cc8cb-5d19-4d3c-a5d5-1e04874034f1 already deleted. [ 596.907433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60cc8cb-5d19-4d3c-a5d5-1e04874034f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.013700] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.090544] env[68828]: INFO networking_nsxv3.common.synchronization [None req-bae838a3-a4ae-4b7d-b4da-1efcebe9ea81 None None] Enqueued Resource ID: 509f0c48-da81-455e-a31a-a7dcb22f1f16 with Priority: HIGHEST for action port [ 597.090797] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 509f0c48-da81-455e-a31a-a7dcb22f1f16 with Priority: HIGHEST for action port [ 597.091396] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-509f0c48-da81-455e-a31a-a7dcb22f1f16 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.091525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-509f0c48-da81-455e-a31a-a7dcb22f1f16" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.091622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-509f0c48-da81-455e-a31a-a7dcb22f1f16" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.092520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-509f0c48-da81-455e-a31a-a7dcb22f1f16" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.095261] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('509f0c48-da81-455e-a31a-a7dcb22f1f16',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.222846] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c55eb713-452e-4803-84ae-58a048b5a359 in Status: SUCCESS [ 597.222846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.225144] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d2c3393f-54db-44e3-bd3b-f777208c105a None None] Enqueued Resource ID: d9c99bd4-0d11-4109-b4b3-0bedaf493f9e with Priority: HIGHEST for action port [ 597.225677] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c99bd4-0d11-4109-b4b3-0bedaf493f9e with Priority: HIGHEST for action port [ 597.226265] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9c99bd4-0d11-4109-b4b3-0bedaf493f9e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.226265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9c99bd4-0d11-4109-b4b3-0bedaf493f9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.226265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9c99bd4-0d11-4109-b4b3-0bedaf493f9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.226692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9c99bd4-0d11-4109-b4b3-0bedaf493f9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.226692] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c99bd4-0d11-4109-b4b3-0bedaf493f9e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.516963] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.518216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.520348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.520348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.520348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.520348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be created. [ 597.532798] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c1a98740-33a6-422b-9c84-e87e0e336fc6 tempest-VolumesAssistedSnapshotsTest-607104416 tempest-VolumesAssistedSnapshotsTest-607104416-project-member] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_rules [ 597.532798] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_rules [ 597.532798] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.532941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.533254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.533405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.533667] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.544541] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.544675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.544743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.544953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.545377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.558411] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: UNINITIALIZED for 2s [ 597.597091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 509f0c48-da81-455e-a31a-a7dcb22f1f16 [ 597.597091] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.597091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.597091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.597091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.597091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.597091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:509f0c48-da81-455e-a31a-a7dcb22f1f16 already deleted. [ 597.597310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-509f0c48-da81-455e-a31a-a7dcb22f1f16" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.731615] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9c99bd4-0d11-4109-b4b3-0bedaf493f9e [ 597.731615] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.731615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.731615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.731615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.731615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.731615] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9c99bd4-0d11-4109-b4b3-0bedaf493f9e already deleted. [ 597.731854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9c99bd4-0d11-4109-b4b3-0bedaf493f9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.823171] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b56e4f8c-d011-4884-8756-c610082f2cb8 tempest-VolumesAssistedSnapshotsTest-607104416 tempest-VolumesAssistedSnapshotsTest-607104416-project-member] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_rules [ 597.823171] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_rules [ 597.823171] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.823171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.882023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 597.882498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.882666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.883028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.883205] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.884063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.884063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.884063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.884063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.884063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.884063] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.056582] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.056582] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 already deleted. [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.056582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.056582] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.136957] env[68828]: INFO networking_nsxv3.common.synchronization [None req-dbc83504-e56a-451b-9e10-26b49df9fc69 None None] Enqueued Resource ID: 03a22cf7-da37-45db-9895-529549c62c33 with Priority: HIGHEST for action port [ 598.137219] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a22cf7-da37-45db-9895-529549c62c33 with Priority: HIGHEST for action port [ 598.138085] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-03a22cf7-da37-45db-9895-529549c62c33 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.138251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03a22cf7-da37-45db-9895-529549c62c33" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.138304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03a22cf7-da37-45db-9895-529549c62c33" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.138590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03a22cf7-da37-45db-9895-529549c62c33" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.138654] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03a22cf7-da37-45db-9895-529549c62c33',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.337322] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b in Status: SUCCESS [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.337322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.337322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.337322] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.388042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.389582] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.389582] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.389582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.390192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.390192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.390192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.390192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.390192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.390192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.390192] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.579621] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.580324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.580324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.580324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.580324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.580522] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 already deleted. [ 598.580522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.648553] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03a22cf7-da37-45db-9895-529549c62c33 [ 598.648788] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.649597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.649676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.649946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.652720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.653408] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03a22cf7-da37-45db-9895-529549c62c33 already deleted. [ 598.653590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03a22cf7-da37-45db-9895-529549c62c33" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.843565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.843565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.843565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.844594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.844926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.845153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.846079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.846079] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.846079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.846079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.846079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.846079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.846877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.847200] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.893319] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa: rpc.has_security_group_logging(os_id): False [ 598.911285] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.911285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.911285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.914236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.914236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.914236] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.914564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.914662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.915075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.915157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.915413] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.915555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.915638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.915853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.915955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.916244] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.916373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.916458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.916668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.918958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.918958] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be created. [ 598.990827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.991078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.991209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.991481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.991748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.009742] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 599.199912] env[68828]: INFO networking_nsxv3.common.synchronization [req-a9dc8dbf-de6b-4aa7-9ddc-594cadf9cea9 req-f6e18f91-6d6d-46f1-a7e1-d6ce087c98d4 tempest-VolumesAdminNegativeTest-51626435 tempest-VolumesAdminNegativeTest-51626435-project-member] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_members [ 599.200271] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_members [ 599.200377] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.200498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.200563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.201474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.201757] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.201853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.201853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.202654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.202654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.202654] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.350051] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65ecb6f4-7309-401b-a695-1d6786a18c4b: rpc.has_security_group_logging(os_id): False [ 599.368540] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.368656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.368694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.369660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.369660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.369660] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.369660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.369660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.369660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.369660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.369984] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.369984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.370091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.370228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.372886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.372886] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.372886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.372886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.372886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.372886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.372886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b is going to be created. [ 599.423649] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.424063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.424165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.424366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.424546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.437078] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b in Status: IN_PROGRESS for 2s [ 599.570671] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 599.571029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.571222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.571448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.571896] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.571896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.571896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.572631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.572631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.572631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.572631] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.706113] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.706358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.706358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.706556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.706645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.706884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.706968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.707018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.707163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.707237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.707323] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 already deleted. [ 599.707402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.078506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.079883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.080099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.080317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.081591] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.081591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.081591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.081591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.081591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.081591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.082013] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.083942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.084034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.084347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.084347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.084539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.084539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.084661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.085258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.085258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.085258] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.345197] env[68828]: INFO networking_nsxv3.common.synchronization [None req-64efc6ad-6eb5-48bc-ab0c-8169c21d1799 None None] Enqueued Resource ID: b1f9251d-cff2-4b42-adcc-be7e935bf942 with Priority: HIGHEST for action port [ 600.345775] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f9251d-cff2-4b42-adcc-be7e935bf942 with Priority: HIGHEST for action port [ 600.352142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f9251d-cff2-4b42-adcc-be7e935bf942 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.352142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f9251d-cff2-4b42-adcc-be7e935bf942" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.352142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f9251d-cff2-4b42-adcc-be7e935bf942" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.352142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f9251d-cff2-4b42-adcc-be7e935bf942" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.352142] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f9251d-cff2-4b42-adcc-be7e935bf942',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.589660] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d71fe85b-2b15-476f-8dc2-6739692bced0: rpc.has_security_group_logging(os_id): False [ 600.612029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.612029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.612029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.612029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.612029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.612315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.612457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.612705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.612767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.612851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.613419] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.613419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.613419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.613582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.613582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.614349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.614349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.614349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.614349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.614349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.614349] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be created. [ 600.635163] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.635163] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.635163] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.635163] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.635163] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.636014] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.636321] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.636752] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.637074] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.637419] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.637652] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.638109] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.638335] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.638616] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.638850] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.640024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.660145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.660145] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 600.660145] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.660145] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.660145] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ee468337-e8f0-4713-a3b9-3028a3a86ff5 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.660145] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.660145] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.660145] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.660145] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee468337-e8f0-4713-a3b9-3028a3a86ff5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.667027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.667027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.667027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.667225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.667410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.679083] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 2s [ 600.850822] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1f9251d-cff2-4b42-adcc-be7e935bf942 [ 600.851101] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.851244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.851331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.851567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.851660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.851752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1f9251d-cff2-4b42-adcc-be7e935bf942 already deleted. [ 600.851850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f9251d-cff2-4b42-adcc-be7e935bf942" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.024346] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 601.024346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.163609] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.163891] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.164070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.164415] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.164583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.164769] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ee468337-e8f0-4713-a3b9-3028a3a86ff5 not found, creating... [ 601.165086] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.165293] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.165429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.166788] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.166788] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.169967] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.169967] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.169967] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.169967] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.169967] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.169967] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ee468337-e8f0-4713-a3b9-3028a3a86ff5 is going to be created. [ 601.188420] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.189664] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.191016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.191016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.191016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.191016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.449196] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b in Status: SUCCESS [ 601.449457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.654783] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b4c2108a-3f8b-4959-a527-288d9ac4101a None None] Enqueued Resource ID: 648c26ba-b80f-48ff-9e8e-7099fa310e66 with Priority: HIGHEST for action port [ 601.655743] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 648c26ba-b80f-48ff-9e8e-7099fa310e66 with Priority: HIGHEST for action port [ 601.658384] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-648c26ba-b80f-48ff-9e8e-7099fa310e66 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.660079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-648c26ba-b80f-48ff-9e8e-7099fa310e66" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.660079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-648c26ba-b80f-48ff-9e8e-7099fa310e66" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.660079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-648c26ba-b80f-48ff-9e8e-7099fa310e66" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.660079] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('648c26ba-b80f-48ff-9e8e-7099fa310e66',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.701612] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc3a6d12-deee-47e6-bc28-a69871b51bcd req-9c55f4c6-5584-4370-9204-2b8b0956e67e tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 601.702101] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 601.703029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.703029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.703029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.703029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.703029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.703292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.703292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.703446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.703551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.703628] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.162566] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 648c26ba-b80f-48ff-9e8e-7099fa310e66 [ 602.163323] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.163323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.163323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.163323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.163323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.163579] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:648c26ba-b80f-48ff-9e8e-7099fa310e66 already deleted. [ 602.163579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-648c26ba-b80f-48ff-9e8e-7099fa310e66" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.206387] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.206531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.206603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.206808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.206899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.207103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.207202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.207266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.207411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.207487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.207570] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 already deleted. [ 602.207669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.692801] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.693092] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.693893] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.693893] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.693893] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.694631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.697155] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.697155] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.697272] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.697532] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.697695] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.698373] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.698492] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.698685] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.698833] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.699962] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.701861] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 602.701861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.721990] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.722160] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 602.722306] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.722487] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.722810] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-6af43c18-d98e-4425-a36c-de3cfd464e62 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.723034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.724765] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.724765] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.724765] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af43c18-d98e-4425-a36c-de3cfd464e62',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.830385] env[68828]: INFO networking_nsxv3.common.synchronization [req-a9dc8dbf-de6b-4aa7-9ddc-594cadf9cea9 req-1991706c-8688-40e3-91ba-ae7aea203891 service nova] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_rules [ 602.830538] env[68828]: INFO networking_nsxv3.common.synchronization [req-a9dc8dbf-de6b-4aa7-9ddc-594cadf9cea9 req-1991706c-8688-40e3-91ba-ae7aea203891 service nova] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_members [ 602.830725] env[68828]: INFO networking_nsxv3.common.synchronization [req-a9dc8dbf-de6b-4aa7-9ddc-594cadf9cea9 req-1991706c-8688-40e3-91ba-ae7aea203891 service nova] Enqueued Resource ID: ee468337-e8f0-4713-a3b9-3028a3a86ff5 with Priority: HIGHEST for action port [ 602.831506] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_rules [ 602.831506] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_members [ 602.832606] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee468337-e8f0-4713-a3b9-3028a3a86ff5 with Priority: HIGHEST for action port [ 602.833756] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.833756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.834349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.834607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.834890] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.835625] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.835745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.835827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.836059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.836463] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.836869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.837118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.837252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.837327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.837440] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.838327] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee468337-e8f0-4713-a3b9-3028a3a86ff5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.838449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.838556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.839508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.839508] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee468337-e8f0-4713-a3b9-3028a3a86ff5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.226274] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.226617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.226688] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.226947] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.227121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.227284] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 6af43c18-d98e-4425-a36c-de3cfd464e62 not found, creating... [ 603.227547] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.227730] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.227857] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.228107] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.228248] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.229046] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.229046] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.229046] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.229046] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.232702] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.232702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 6af43c18-d98e-4425-a36c-de3cfd464e62 is going to be created. [ 603.254552] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.254552] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.254552] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.254552] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.254552] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.255373] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.342198] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.342827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.342938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.343313] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee468337-e8f0-4713-a3b9-3028a3a86ff5 with status ACTIVE [ 603.343542] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.343654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.343718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.343961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.344061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.344223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.345129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.345129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.345243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.345243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.345416] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.345504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.345564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.345703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.345785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.345867] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee468337-e8f0-4713-a3b9-3028a3a86ff5 is going to be updated. [ 603.367289] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.367433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.367508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.367707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.367843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.367996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee468337-e8f0-4713-a3b9-3028a3a86ff5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.582321] env[68828]: INFO networking_nsxv3.common.synchronization [req-454a40f4-6d52-4a17-89f8-30ea79a73238 req-e5d34eff-48a9-46ba-a718-25d47f6b7685 tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 603.582916] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 603.583227] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.583351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.583413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.583660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.583807] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.583898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.583957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.584128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.584219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.584306] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.599707] env[68828]: INFO networking_nsxv3.common.synchronization [None req-41128963-d7e0-454a-9121-854f073d9c92 None None] Enqueued Resource ID: f88624c5-9008-4cee-ad0e-2bef8343b510 with Priority: HIGHEST for action port [ 603.600950] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88624c5-9008-4cee-ad0e-2bef8343b510 with Priority: HIGHEST for action port [ 603.600950] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f88624c5-9008-4cee-ad0e-2bef8343b510 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.600950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f88624c5-9008-4cee-ad0e-2bef8343b510" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.600950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f88624c5-9008-4cee-ad0e-2bef8343b510" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.600950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f88624c5-9008-4cee-ad0e-2bef8343b510" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.601894] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f88624c5-9008-4cee-ad0e-2bef8343b510',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.844131] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.975560] env[68828]: INFO networking_nsxv3.common.synchronization [None req-82af0852-551a-40a9-9592-12c234a36de8 None None] Enqueued Resource ID: 5a295db6-6649-4379-b076-19e028179c95 with Priority: HIGHEST for action port [ 603.976159] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a295db6-6649-4379-b076-19e028179c95 with Priority: HIGHEST for action port [ 603.976425] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a295db6-6649-4379-b076-19e028179c95 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.976541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a295db6-6649-4379-b076-19e028179c95" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.976598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a295db6-6649-4379-b076-19e028179c95" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.976881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a295db6-6649-4379-b076-19e028179c95" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.976965] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a295db6-6649-4379-b076-19e028179c95',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.086228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.086407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.086476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.086726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.086853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.087079] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.087195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.087278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.087530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.087530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.087876] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 already deleted. [ 604.087876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.105283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f88624c5-9008-4cee-ad0e-2bef8343b510 [ 604.105577] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.105709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.105856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.106542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.106878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.106878] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f88624c5-9008-4cee-ad0e-2bef8343b510 already deleted. [ 604.107029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f88624c5-9008-4cee-ad0e-2bef8343b510" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.349456] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.349673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.349790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.349992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.350101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.350221] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 is going to be created. [ 604.380284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.381517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.383631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.383631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.383631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.391649] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: UNINITIALIZED for 2s [ 604.480500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a295db6-6649-4379-b076-19e028179c95 [ 604.480500] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.480500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.480500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.480500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.480500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.480500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a295db6-6649-4379-b076-19e028179c95 already deleted. [ 604.480500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a295db6-6649-4379-b076-19e028179c95" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.517480] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-165 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.517697] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.520912] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.522523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.522989] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.523254] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.523383] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.523663] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.523823] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.525162] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.525925] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.525925] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.526435] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.526604] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.526725] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.526894] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.545991] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.545991] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 604.545991] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.545991] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.549893] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.550226] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.550352] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.550746] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.550893] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb580cfe-1ec8-4bd1-880e-dfdd576645c8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.767888] env[68828]: INFO networking_nsxv3.common.synchronization [None req-e968982a-8579-48dd-a537-9138cbfddf58 tempest-ServersWithSpecificFlavorTestJSON-1891684402 tempest-ServersWithSpecificFlavorTestJSON-1891684402-project-member] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 604.768581] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 604.773254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.773402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.773402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.773702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.773788] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.978978] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc3a6d12-deee-47e6-bc28-a69871b51bcd req-c97f77ca-4c4d-461d-82fc-ecf36f2ed394 service nova] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_rules [ 604.982627] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc3a6d12-deee-47e6-bc28-a69871b51bcd req-c97f77ca-4c4d-461d-82fc-ecf36f2ed394 service nova] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 604.982627] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc3a6d12-deee-47e6-bc28-a69871b51bcd req-c97f77ca-4c4d-461d-82fc-ecf36f2ed394 service nova] Enqueued Resource ID: 6af43c18-d98e-4425-a36c-de3cfd464e62 with Priority: HIGHEST for action port [ 604.982753] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_rules [ 604.982906] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 604.982987] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6af43c18-d98e-4425-a36c-de3cfd464e62 with Priority: HIGHEST for action port [ 604.985342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.985649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.985720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.986235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.986235] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.987564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.987695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.988067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.988287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.988438] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.988546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.988604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.988747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.988862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.988960] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.989882] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6af43c18-d98e-4425-a36c-de3cfd464e62 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.989998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.990075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.990218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.990288] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af43c18-d98e-4425-a36c-de3cfd464e62',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.033386] env[68828]: INFO networking_nsxv3.common.synchronization [None req-62ecabef-c344-4af2-82d7-62a509d7844c tempest-ServersWithSpecificFlavorTestJSON-1891684402 tempest-ServersWithSpecificFlavorTestJSON-1891684402-project-member] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 605.033982] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 605.038249] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.038413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.054925] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.056372] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.056836] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.057255] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.057507] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.057723] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port cb580cfe-1ec8-4bd1-880e-dfdd576645c8 not found, creating... [ 605.058067] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.058283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.059129] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.059407] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.059560] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.059947] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.060159] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.060237] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.060462] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.060597] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.060750] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: cb580cfe-1ec8-4bd1-880e-dfdd576645c8 is going to be created. [ 605.122014] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.122600] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.122600] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.122600] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.122791] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.123055] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.293452] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.293603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.293675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.293887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.293983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.294108] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc128506-c5e7-4179-a805-6679a20e9957 already deleted. [ 605.294196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.294358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.294517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.294601] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.465490] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9c88ba33-46bc-40ea-992f-bbd10c43ea05 None None] Enqueued Resource ID: 1d20b373-1860-4900-85db-057f9e97f641 with Priority: HIGHEST for action port [ 605.466113] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d20b373-1860-4900-85db-057f9e97f641 with Priority: HIGHEST for action port [ 605.466434] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d20b373-1860-4900-85db-057f9e97f641 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.466550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d20b373-1860-4900-85db-057f9e97f641" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.466615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d20b373-1860-4900-85db-057f9e97f641" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.466870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d20b373-1860-4900-85db-057f9e97f641" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.466949] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d20b373-1860-4900-85db-057f9e97f641',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.493098] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.497024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.497024] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.497024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6af43c18-d98e-4425-a36c-de3cfd464e62 with status ACTIVE [ 605.499667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.500472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.500575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.500907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.501084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.501316] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.501667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.501954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.502134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.502191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.502630] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.502740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.502926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.503192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.503441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.503604] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6af43c18-d98e-4425-a36c-de3cfd464e62 is going to be updated. [ 605.526622] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.526622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.526622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.526622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.526622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.526622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6af43c18-d98e-4425-a36c-de3cfd464e62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.612366] env[68828]: INFO networking_nsxv3.common.synchronization [None req-58d431c0-f9b8-4c54-8804-1fd922f8a45e None None] Enqueued Resource ID: 2d6f341a-e517-483d-8684-5c044a4a3ab3 with Priority: HIGHEST for action port [ 605.612633] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6f341a-e517-483d-8684-5c044a4a3ab3 with Priority: HIGHEST for action port [ 605.613193] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6f341a-e517-483d-8684-5c044a4a3ab3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.613307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6f341a-e517-483d-8684-5c044a4a3ab3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.613370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6f341a-e517-483d-8684-5c044a4a3ab3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.613625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6f341a-e517-483d-8684-5c044a4a3ab3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.613703] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6f341a-e517-483d-8684-5c044a4a3ab3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.820024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.820024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.820024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.820024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.820024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.820024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc128506-c5e7-4179-a805-6679a20e9957 already deleted. [ 605.820024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.969348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d20b373-1860-4900-85db-057f9e97f641 [ 605.971839] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.973248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.973248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.973248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.973248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.973248] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d20b373-1860-4900-85db-057f9e97f641 already deleted. [ 605.973248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d20b373-1860-4900-85db-057f9e97f641" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.007491] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.120413] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d6f341a-e517-483d-8684-5c044a4a3ab3 [ 606.120413] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.120413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.120413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.120646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.120646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.120727] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d6f341a-e517-483d-8684-5c044a4a3ab3 already deleted. [ 606.121234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6f341a-e517-483d-8684-5c044a4a3ab3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.271657] env[68828]: INFO networking_nsxv3.common.synchronization [req-866d2727-abc9-4914-9eb6-51c1db2960c3 req-2ea6cf31-6dd7-4dc8-b84d-664ed92a9e47 tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 606.271840] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 606.272803] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.272969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.273051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.273223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.273386] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.273491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.273550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.273702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.273839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.273897] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.400427] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: SUCCESS [ 606.400660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.400906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.401115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.401307] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.401426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.401490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.401640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.401722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.401808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.401908] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.510076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.510266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.510305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.510542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.510636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.510740] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be created. [ 606.531817] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.531956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.531956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.532217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.532375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.541118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: UNINITIALIZED for 2s [ 606.778188] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.819165] env[68828]: INFO networking_nsxv3.common.synchronization [req-84e544f2-174e-416e-ba6a-4fb51108b227 req-e4a932c7-5a9f-4e4c-aa86-f49ce49e40e7 tempest-DeleteServersAdminTestJSON-902269076 tempest-DeleteServersAdminTestJSON-902269076-project-admin] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 606.820155] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 606.820875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.821935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.822105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.822414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.823287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.823474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.823871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.823980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.824128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.824339] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.906172] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.111793] env[68828]: INFO networking_nsxv3.common.synchronization [req-454a40f4-6d52-4a17-89f8-30ea79a73238 req-391d9268-d525-4f2f-95ae-b24fc6e2524c service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 607.112139] env[68828]: INFO networking_nsxv3.common.synchronization [req-454a40f4-6d52-4a17-89f8-30ea79a73238 req-391d9268-d525-4f2f-95ae-b24fc6e2524c service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 607.112196] env[68828]: INFO networking_nsxv3.common.synchronization [req-454a40f4-6d52-4a17-89f8-30ea79a73238 req-391d9268-d525-4f2f-95ae-b24fc6e2524c service nova] Enqueued Resource ID: cb580cfe-1ec8-4bd1-880e-dfdd576645c8 with Priority: HIGHEST for action port [ 607.112737] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 607.112896] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 607.113202] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb580cfe-1ec8-4bd1-880e-dfdd576645c8 with Priority: HIGHEST for action port [ 607.113566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.113708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.113770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.114070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.114139] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.115062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.115156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.115474] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.115611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.115657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.115921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.116048] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb580cfe-1ec8-4bd1-880e-dfdd576645c8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.281231] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.328162] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.328335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.328406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.328626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.328716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.328931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.329062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.329114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.329245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.329341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.329398] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be updated. [ 607.368153] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.370635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.370713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.370945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.371226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.382389] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: IN_PROGRESS for 2s [ 607.408548] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8e993f1-ee06-4325-98b9-4dc8467a2fb3: rpc.has_security_group_logging(os_id): False [ 607.425917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.426249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.426249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.429787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.429787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.429787] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.429787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.429787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.429787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.429787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.429787] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 is going to be created. [ 607.510407] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.510594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.510594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.510824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.511015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.523387] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: IN_PROGRESS for 2s [ 607.621647] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.621647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.621647] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb580cfe-1ec8-4bd1-880e-dfdd576645c8 with status ACTIVE [ 607.621647] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.621647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.621647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.621890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.621984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.622524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.622942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.624370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.624370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.624370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.624370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.625014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.625338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.625338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.625509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.625509] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb580cfe-1ec8-4bd1-880e-dfdd576645c8 is going to be updated. [ 607.658329] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.658615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.658944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.659140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.659358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.659612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb580cfe-1ec8-4bd1-880e-dfdd576645c8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.786359] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-165 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.788268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.788672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.789262] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.789868] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.790268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.790440] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.790915] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.795363] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.795652] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 607.795823] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.795957] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.796084] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.796235] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 607.796340] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.796505] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.804705] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.804705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.804705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.805026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.805094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.805245] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be created. [ 607.840982] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.840982] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 607.840982] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.840982] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.841358] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ff3702da-09a3-4df6-81e6-8b417dc9ed15 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.841519] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.841641] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.842923] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.843393] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff3702da-09a3-4df6-81e6-8b417dc9ed15',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.855055] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.855055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.855055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.855055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.856027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.867886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: UNINITIALIZED for 2s [ 608.326162] env[68828]: INFO networking_nsxv3.common.synchronization [None req-96779e91-2459-4021-92b4-3940e8520ddd None None] Enqueued Resource ID: b7b6843d-fb9a-4240-aa53-93a034abdf79 with Priority: HIGHEST for action port [ 608.329014] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7b6843d-fb9a-4240-aa53-93a034abdf79 with Priority: HIGHEST for action port [ 608.331136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7b6843d-fb9a-4240-aa53-93a034abdf79 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.331136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7b6843d-fb9a-4240-aa53-93a034abdf79" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.331136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7b6843d-fb9a-4240-aa53-93a034abdf79" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.331136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7b6843d-fb9a-4240-aa53-93a034abdf79" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.331136] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b6843d-fb9a-4240-aa53-93a034abdf79',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.346022] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.346249] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.346374] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.346666] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.346816] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.346991] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ff3702da-09a3-4df6-81e6-8b417dc9ed15 not found, creating... [ 608.347265] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.347428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.348036] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.348036] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.348036] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.348294] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.348450] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.348565] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.348796] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.352340] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.352901] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ff3702da-09a3-4df6-81e6-8b417dc9ed15 is going to be created. [ 608.374119] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.374119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.374119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.374119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.374119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.374119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.553730] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.553730] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.553730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.553730] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.832551] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7b6843d-fb9a-4240-aa53-93a034abdf79 [ 608.832809] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.832950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.833066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.833325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.833801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.833801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7b6843d-fb9a-4240-aa53-93a034abdf79 already deleted. [ 608.833801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7b6843d-fb9a-4240-aa53-93a034abdf79" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.056876] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.057162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.057260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.057542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.057732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.057840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.057905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.058085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.058169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.058258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.058405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.058498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.058561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.058700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.058832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.058920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.058979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.059125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.059198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.059279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.059364] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.079531] env[68828]: INFO networking_nsxv3.common.synchronization [None req-376e7f1b-9773-4590-a4db-ff8e325a8c56 None None] Enqueued Resource ID: a43d6dc9-d0ff-4006-b94f-bcee9814a1fb with Priority: HIGHEST for action port [ 609.079968] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43d6dc9-d0ff-4006-b94f-bcee9814a1fb with Priority: HIGHEST for action port [ 609.082058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-a43d6dc9-d0ff-4006-b94f-bcee9814a1fb taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.082058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a43d6dc9-d0ff-4006-b94f-bcee9814a1fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.082058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a43d6dc9-d0ff-4006-b94f-bcee9814a1fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.082058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a43d6dc9-d0ff-4006-b94f-bcee9814a1fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.082058] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a43d6dc9-d0ff-4006-b94f-bcee9814a1fb',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.393493] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 609.393800] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d deletion is rescheduled due to dependency. [ 609.393800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.535467] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: SUCCESS [ 609.536163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.562630] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1: rpc.has_security_group_logging(os_id): False [ 609.584157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.584157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.584157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.584157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.585343] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.585667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.585900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.586183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.586647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.586861] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be created. [ 609.588774] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a43d6dc9-d0ff-4006-b94f-bcee9814a1fb [ 609.589363] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.589873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.589873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.590376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.591334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.591334] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a43d6dc9-d0ff-4006-b94f-bcee9814a1fb already deleted. [ 609.591334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a43d6dc9-d0ff-4006-b94f-bcee9814a1fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.645846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.646059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.646059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.646302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.646499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.660639] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: IN_PROGRESS for 2s [ 609.877473] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 609.877649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.877849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.878081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.878274] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.878983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.879515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.879730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.879883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.879991] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.968144] env[68828]: INFO networking_nsxv3.common.synchronization [req-866d2727-abc9-4914-9eb6-51c1db2960c3 req-cb5a1a63-c333-43f1-aa4a-41aa5d9a6e92 service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 609.968482] env[68828]: INFO networking_nsxv3.common.synchronization [req-866d2727-abc9-4914-9eb6-51c1db2960c3 req-cb5a1a63-c333-43f1-aa4a-41aa5d9a6e92 service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 609.968782] env[68828]: INFO networking_nsxv3.common.synchronization [req-866d2727-abc9-4914-9eb6-51c1db2960c3 req-cb5a1a63-c333-43f1-aa4a-41aa5d9a6e92 service nova] Enqueued Resource ID: ff3702da-09a3-4df6-81e6-8b417dc9ed15 with Priority: HIGHEST for action port [ 609.969456] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 609.972019] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 609.972019] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff3702da-09a3-4df6-81e6-8b417dc9ed15 with Priority: HIGHEST for action port [ 609.972019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.972019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.972019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.972019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.972019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff3702da-09a3-4df6-81e6-8b417dc9ed15 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.972019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.972019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.972019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.972019] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff3702da-09a3-4df6-81e6-8b417dc9ed15',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.359205] env[68828]: INFO networking_nsxv3.common.synchronization [req-d1e2123f-710c-44d7-a9fa-d30ce2673e2d req-98a9984d-d952-4b0c-969e-aaa1ffd7a9ea tempest-ServerDiagnosticsNegativeTest-376201189 tempest-ServerDiagnosticsNegativeTest-376201189-project-member] Enqueued Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_members [ 610.359205] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGHEST for action security_group_members [ 610.359205] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.359205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.359205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.359205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.359205] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.359205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.359205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.359805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.360120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.360502] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.382184] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.474959] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff3702da-09a3-4df6-81e6-8b417dc9ed15 with status ACTIVE [ 610.475218] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.475344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.475411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.475621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.475714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.475913] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.476039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.476104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.476256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.476330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.476501] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.476588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.476646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.476788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.476855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.476935] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff3702da-09a3-4df6-81e6-8b417dc9ed15 is going to be updated. [ 610.498494] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.498635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.498704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.498978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.499123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.499287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff3702da-09a3-4df6-81e6-8b417dc9ed15" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.827661] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6ded4902-1f8a-48bc-bc0b-ae82cca19073 None None] Enqueued Resource ID: 631bec3b-f757-401d-ab48-2dfafd4e0b35 with Priority: HIGHEST for action port [ 610.828242] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 631bec3b-f757-401d-ab48-2dfafd4e0b35 with Priority: HIGHEST for action port [ 610.829304] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-631bec3b-f757-401d-ab48-2dfafd4e0b35 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.829545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-631bec3b-f757-401d-ab48-2dfafd4e0b35" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.829545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-631bec3b-f757-401d-ab48-2dfafd4e0b35" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.829924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-631bec3b-f757-401d-ab48-2dfafd4e0b35" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.829924] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('631bec3b-f757-401d-ab48-2dfafd4e0b35',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.864203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.864203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.864203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.864203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.864203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.864203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.864436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.864436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.864506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.864538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.864977] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb85f31-5e65-47cb-bc60-aada80785442 is going to be updated. [ 610.884975] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.891368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.891452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.891522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.891740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.891876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.902942] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb85f31-5e65-47cb-bc60-aada80785442 in Status: IN_PROGRESS for 2s [ 610.948684] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b2e1d500-17b1-4adc-9944-53df4e068feb tempest-ServersV294TestFqdnHostnames-978881238 tempest-ServersV294TestFqdnHostnames-978881238-project-member] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_rules [ 610.949266] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_rules [ 610.949996] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.951524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.951788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.952222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.956103] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.215275] env[68828]: INFO networking_nsxv3.common.synchronization [req-7fdaf602-e43e-403f-ba5f-c018edf91639 req-687604b6-614e-4b17-bb3d-f94123bcec30 tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 611.215847] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 611.220010] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.220224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.220305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.220567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.220805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.220929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.221032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.221193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.221314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.221413] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.259151] env[68828]: INFO networking_nsxv3.common.synchronization [None req-48671028-cd06-4ff2-930c-6a2422a09988 tempest-ServersV294TestFqdnHostnames-978881238 tempest-ServersV294TestFqdnHostnames-978881238-project-member] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_rules [ 611.259655] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_rules [ 611.259989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.260129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.332075] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 631bec3b-f757-401d-ab48-2dfafd4e0b35 [ 611.332440] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.332647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.332770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.333066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.333172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.333294] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:631bec3b-f757-401d-ab48-2dfafd4e0b35 already deleted. [ 611.333398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-631bec3b-f757-401d-ab48-2dfafd4e0b35" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.390023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.390023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.390023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.390023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.390023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.390023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 611.417558] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.417718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.417790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.418050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.418216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.433652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 611.474623] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.474807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.474857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.475102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.475365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.475365] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c already deleted. [ 611.475365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.475469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.476042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.476042] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.677461] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 611.677715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.724196] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.996198] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.996327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.996409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.997047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.997047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.997047] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c already deleted. [ 611.997145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.228413] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.582385] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.582705] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.582747] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.583113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.583279] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.583439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.583558] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.583776] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.583919] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.584694] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 612.584832] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.584982] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.585123] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.585241] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 612.585350] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.585488] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.610600] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.610780] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 612.610942] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.611154] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.611485] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-b5754274-3349-435b-b48e-ebe37fc01e72 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.611667] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.611773] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.612489] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.612632] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5754274-3349-435b-b48e-ebe37fc01e72',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.730877] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.731347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.731530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.732011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.732973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.733155] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be updated. [ 612.762168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.762449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.763240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.763423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.764100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.775962] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: IN_PROGRESS for 2s [ 612.834247] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6ab4146b-2838-4a27-aefb-c617158ec70a None None] Enqueued Resource ID: add60add-6b10-4381-bf93-4d01a5ecee3b with Priority: HIGHEST for action port [ 612.834891] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: add60add-6b10-4381-bf93-4d01a5ecee3b with Priority: HIGHEST for action port [ 612.837151] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-add60add-6b10-4381-bf93-4d01a5ecee3b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.837344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-add60add-6b10-4381-bf93-4d01a5ecee3b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.837462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-add60add-6b10-4381-bf93-4d01a5ecee3b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.837778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-add60add-6b10-4381-bf93-4d01a5ecee3b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.837880] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('add60add-6b10-4381-bf93-4d01a5ecee3b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.916780] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bb85f31-5e65-47cb-bc60-aada80785442 in Status: SUCCESS [ 612.916780] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bb85f31-5e65-47cb-bc60-aada80785442 deletion is rescheduled due to dependency. [ 612.916780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.115267] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.116898] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port b5754274-3349-435b-b48e-ebe37fc01e72 not found, creating... [ 613.116898] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.116898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.117661] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.117661] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.117661] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.117661] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.118168] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.118168] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.118319] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: b5754274-3349-435b-b48e-ebe37fc01e72 is going to be created. [ 613.144583] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.144797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.144925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.145584] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.145584] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.147026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.341038] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port add60add-6b10-4381-bf93-4d01a5ecee3b [ 613.341038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.341226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.341274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.341489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.341581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.342079] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:add60add-6b10-4381-bf93-4d01a5ecee3b already deleted. [ 613.342079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-add60add-6b10-4381-bf93-4d01a5ecee3b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.442826] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 613.443060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.444860] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.444860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.444860] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.445625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.445854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.446197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.446267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.446380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.446694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.446840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.446996] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.948702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.949151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.949151] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.451026] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.492653] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c7524bec-c78e-4986-8b79-49776d2dd998 None None] Enqueued Resource ID: ffb2d58c-2e42-4c78-bdd3-d721afbc55e8 with Priority: HIGHEST for action port [ 614.493259] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb2d58c-2e42-4c78-bdd3-d721afbc55e8 with Priority: HIGHEST for action port [ 614.493628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffb2d58c-2e42-4c78-bdd3-d721afbc55e8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.493773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffb2d58c-2e42-4c78-bdd3-d721afbc55e8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.493864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffb2d58c-2e42-4c78-bdd3-d721afbc55e8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.494231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffb2d58c-2e42-4c78-bdd3-d721afbc55e8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.494349] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffb2d58c-2e42-4c78-bdd3-d721afbc55e8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.677256] env[68828]: INFO networking_nsxv3.common.synchronization [req-7fdaf602-e43e-403f-ba5f-c018edf91639 req-beb65d57-eaa3-4fe0-941c-ebb7d295ee9e service nova] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_rules [ 614.677256] env[68828]: INFO networking_nsxv3.common.synchronization [req-7fdaf602-e43e-403f-ba5f-c018edf91639 req-beb65d57-eaa3-4fe0-941c-ebb7d295ee9e service nova] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 614.677474] env[68828]: INFO networking_nsxv3.common.synchronization [req-7fdaf602-e43e-403f-ba5f-c018edf91639 req-beb65d57-eaa3-4fe0-941c-ebb7d295ee9e service nova] Enqueued Resource ID: b5754274-3349-435b-b48e-ebe37fc01e72 with Priority: HIGHEST for action port [ 614.678377] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_rules [ 614.678568] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 614.679123] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5754274-3349-435b-b48e-ebe37fc01e72 with Priority: HIGHEST for action port [ 614.679395] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.679604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.679771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.680166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.680336] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.681453] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.681607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.681894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5754274-3349-435b-b48e-ebe37fc01e72 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.681996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.682070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.682269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.682346] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5754274-3349-435b-b48e-ebe37fc01e72',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.739579] env[68828]: INFO networking_nsxv3.common.synchronization [req-455e6336-6311-4c20-b758-897182458192 req-f8f9dc6a-1bea-435d-b0c1-e73af1610f78 tempest-TenantUsagesTestJSON-1368908414 tempest-TenantUsagesTestJSON-1368908414-project-member] Enqueued Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_members [ 614.739898] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGHEST for action security_group_members [ 614.740821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.740821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.740821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.740821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.740821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.741127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.741127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.741127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.741219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.741354] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.790451] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.790451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.790451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.790451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.954232] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.955924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.955924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.955924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.955924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.955924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 614.987567] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.987567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.987567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.987567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.988116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.996742] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 615.001165] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffb2d58c-2e42-4c78-bdd3-d721afbc55e8 [ 615.001979] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.001979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.001979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.001979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.001979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.002875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffb2d58c-2e42-4c78-bdd3-d721afbc55e8 already deleted. [ 615.002875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffb2d58c-2e42-4c78-bdd3-d721afbc55e8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.189136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189136] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5754274-3349-435b-b48e-ebe37fc01e72 with status ACTIVE [ 615.189136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.189136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.189136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.189136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.189634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.189634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.189634] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5754274-3349-435b-b48e-ebe37fc01e72 is going to be updated. [ 615.215544] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.215544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.215544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.216851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.216851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.216851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5754274-3349-435b-b48e-ebe37fc01e72" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.230668] env[68828]: INFO networking_nsxv3.common.synchronization [req-3bf5769e-d82c-4b65-9ae7-67693fd4a2db req-5c1bb9b0-017d-4842-b223-23caf575ff10 tempest-ServerAddressesTestJSON-808422504 tempest-ServerAddressesTestJSON-808422504-project-member] Enqueued Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_members [ 615.230668] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGHEST for action security_group_members [ 615.230668] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.230668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.230668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.231464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.231759] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.231988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.232151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.232393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.232567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.232739] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.243826] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.244594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.244692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.245816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.245816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.245921] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.245987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.246721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.246721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.246721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.246721] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c55eb713-452e-4803-84ae-58a048b5a359 is going to be updated. [ 615.280183] env[68828]: INFO networking_nsxv3.common.synchronization [None req-41c0367a-7b16-493b-93f5-042880c1d31b None None] Enqueued Resource ID: 472b135e-5690-4e00-9f30-0f590319389e with Priority: HIGHEST for action port [ 615.280665] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472b135e-5690-4e00-9f30-0f590319389e with Priority: HIGHEST for action port [ 615.280974] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-472b135e-5690-4e00-9f30-0f590319389e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.281116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-472b135e-5690-4e00-9f30-0f590319389e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.281187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-472b135e-5690-4e00-9f30-0f590319389e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.281484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-472b135e-5690-4e00-9f30-0f590319389e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.281565] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('472b135e-5690-4e00-9f30-0f590319389e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.283917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.284056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.284123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.284305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.284434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.297591] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.301274] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c55eb713-452e-4803-84ae-58a048b5a359 in Status: IN_PROGRESS for 2s [ 615.730742] env[68828]: INFO networking_nsxv3.common.synchronization [None req-22b9a3a0-b5a4-43ed-be5d-dd4c6d2f1aec None None] Enqueued Resource ID: 2de87c16-269e-4897-b3b5-8e5842cf7f5e with Priority: HIGHEST for action port [ 615.730742] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2de87c16-269e-4897-b3b5-8e5842cf7f5e with Priority: HIGHEST for action port [ 615.730742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2de87c16-269e-4897-b3b5-8e5842cf7f5e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.730742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2de87c16-269e-4897-b3b5-8e5842cf7f5e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.730742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2de87c16-269e-4897-b3b5-8e5842cf7f5e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.730742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2de87c16-269e-4897-b3b5-8e5842cf7f5e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.730967] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de87c16-269e-4897-b3b5-8e5842cf7f5e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.738697] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.738697] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.738697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.738697] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b is going to be updated. [ 615.786647] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 472b135e-5690-4e00-9f30-0f590319389e [ 615.787112] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.787112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.787112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.787450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.787450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.787524] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:472b135e-5690-4e00-9f30-0f590319389e already deleted. [ 615.787554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-472b135e-5690-4e00-9f30-0f590319389e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.799406] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.800190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.800301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.800520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.800752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.802986] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.813573] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b in Status: IN_PROGRESS for 2s [ 616.235151] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2de87c16-269e-4897-b3b5-8e5842cf7f5e [ 616.235479] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.235560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.235637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.235885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.235950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.236143] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2de87c16-269e-4897-b3b5-8e5842cf7f5e already deleted. [ 616.236143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2de87c16-269e-4897-b3b5-8e5842cf7f5e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.306309] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.306472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.306546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.306764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.306853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.306949] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be updated. [ 616.341025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.341025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.341025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.341025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.341025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.348674] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: IN_PROGRESS for 2s [ 617.009098] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 617.009363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.009843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.009843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.009967] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.010400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.010400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.010400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.010400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.010563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.010600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.010703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.010748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.011684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.013118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.013281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.013669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.013669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.013669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.013669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.013885] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.311446] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c55eb713-452e-4803-84ae-58a048b5a359 in Status: SUCCESS [ 617.311446] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c55eb713-452e-4803-84ae-58a048b5a359 deletion is rescheduled due to dependency. [ 617.311777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.517562] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6a0522b-dbc3-42bf-8801-b6e755596373: rpc.has_security_group_logging(os_id): False [ 617.538139] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.538139] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.538139] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.538633] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.538633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.538633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.538633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.538633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.539555] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be created. [ 617.599801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.599933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.600816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.600816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.600816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.612081] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 617.825944] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b in Status: SUCCESS [ 617.825944] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b deletion is rescheduled due to dependency. [ 617.825944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.923456] env[68828]: INFO networking_nsxv3.common.synchronization [None req-97f63b83-a3e1-40d5-8a8d-adf3c8ed5529 None None] Enqueued Resource ID: ef21bac4-a0ea-46ff-b3cc-169d2d7220e3 with Priority: HIGHEST for action port [ 617.923731] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef21bac4-a0ea-46ff-b3cc-169d2d7220e3 with Priority: HIGHEST for action port [ 617.924347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef21bac4-a0ea-46ff-b3cc-169d2d7220e3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.924483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef21bac4-a0ea-46ff-b3cc-169d2d7220e3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.924538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef21bac4-a0ea-46ff-b3cc-169d2d7220e3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.924789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef21bac4-a0ea-46ff-b3cc-169d2d7220e3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.924871] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef21bac4-a0ea-46ff-b3cc-169d2d7220e3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.360216] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 618.360480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.363018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.363018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.363018] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.434611] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef21bac4-a0ea-46ff-b3cc-169d2d7220e3 [ 618.435056] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.435380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.436105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.436372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.437437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.437437] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef21bac4-a0ea-46ff-b3cc-169d2d7220e3 already deleted. [ 618.437437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef21bac4-a0ea-46ff-b3cc-169d2d7220e3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.510913] env[68828]: INFO networking_nsxv3.common.synchronization [None req-e0e3dc96-a1fd-40f1-935c-a16d7fb12f65 None None] Enqueued Resource ID: d279f140-ce00-4dc0-a5e1-89d9de2a2e73 with Priority: HIGHEST for action port [ 618.511223] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d279f140-ce00-4dc0-a5e1-89d9de2a2e73 with Priority: HIGHEST for action port [ 618.513650] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d279f140-ce00-4dc0-a5e1-89d9de2a2e73 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.513650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d279f140-ce00-4dc0-a5e1-89d9de2a2e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.513650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d279f140-ce00-4dc0-a5e1-89d9de2a2e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.513650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d279f140-ce00-4dc0-a5e1-89d9de2a2e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.513650] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d279f140-ce00-4dc0-a5e1-89d9de2a2e73',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.865543] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.866236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.866289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.866498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.866815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.866815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.866929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.867020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.867106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.867475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.867475] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.867475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.867475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.867641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.868075] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.868075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.868075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.868075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.868218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.868218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.868286] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.964875] env[68828]: INFO networking_nsxv3.common.synchronization [req-f3297412-687b-4f8f-be3a-6d49eb883b53 req-685544dc-f194-45e3-bb10-28e490293fff tempest-SecurityGroupRulesNegativeTestJSON-1632437278 tempest-SecurityGroupRulesNegativeTestJSON-1632437278-project-member] Enqueued Resource ID: aa618863-8a7e-4031-a1a1-59082eb1ce40 with Priority: HIGHEST for action security_group_rules [ 618.965776] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa618863-8a7e-4031-a1a1-59082eb1ce40 with Priority: HIGHEST for action security_group_rules [ 618.969972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa618863-8a7e-4031-a1a1-59082eb1ce40 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.969972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.969972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.970112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.970208] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa618863-8a7e-4031-a1a1-59082eb1ce40',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.016053] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d279f140-ce00-4dc0-a5e1-89d9de2a2e73 [ 619.016299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.016434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.016513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.016745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.016835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.016934] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d279f140-ce00-4dc0-a5e1-89d9de2a2e73 already deleted. [ 619.017038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d279f140-ce00-4dc0-a5e1-89d9de2a2e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.372593] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1: rpc.has_security_group_logging(os_id): False [ 619.389897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.389897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.389897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.389897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.389897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.392929] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.393150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.393220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.393600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.393600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.393731] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.395480] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.395480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.395480] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be updated. [ 619.452560] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.452734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.452830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.453095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.453276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.468891] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: IN_PROGRESS for 2s [ 619.491039] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.491211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.491299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.491554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.491705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.491766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa618863-8a7e-4031-a1a1-59082eb1ce40 already deleted. [ 619.491860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.625118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 619.625468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.625684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.625956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.626362] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.130331] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.130331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.130331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.130331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.130331] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.131245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.131353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.131558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.131855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.131991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.132496] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.335024] env[68828]: INFO networking_nsxv3.common.synchronization [None req-56e56a03-a186-4c1c-a2ef-73c860988a87 None None] Enqueued Resource ID: bc32da6c-50e8-4c84-b0b7-bdf46faebc52 with Priority: HIGHEST for action port [ 620.335290] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc32da6c-50e8-4c84-b0b7-bdf46faebc52 with Priority: HIGHEST for action port [ 620.335897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc32da6c-50e8-4c84-b0b7-bdf46faebc52 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.336048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc32da6c-50e8-4c84-b0b7-bdf46faebc52" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.336120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc32da6c-50e8-4c84-b0b7-bdf46faebc52" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.336378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc32da6c-50e8-4c84-b0b7-bdf46faebc52" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.336469] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc32da6c-50e8-4c84-b0b7-bdf46faebc52',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.581746] env[68828]: INFO networking_nsxv3.common.synchronization [req-80a82df1-b48e-4064-9a58-389017182e13 req-617baabf-148c-4f58-a8be-6177f4fed7f6 tempest-VolumesAssistedSnapshotsTest-607104416 tempest-VolumesAssistedSnapshotsTest-607104416-project-member] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_members [ 620.582236] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_members [ 620.582538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.586428] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.586428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.586428] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.636564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.638404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.638404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.638404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.638404] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.638404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.638404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.639051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.639121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.639209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.639370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.639482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.639532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.639684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.639823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.640030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.640030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.640160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.640429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.640429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.640570] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.838631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc32da6c-50e8-4c84-b0b7-bdf46faebc52 [ 620.838870] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.839055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.839132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.839761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.839761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.839761] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc32da6c-50e8-4c84-b0b7-bdf46faebc52 already deleted. [ 620.839761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc32da6c-50e8-4c84-b0b7-bdf46faebc52" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.089723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.089723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.089852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.090079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.090233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.090451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.090565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.090646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.090814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.090904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.091485] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 already deleted. [ 621.091485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.146321] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6a0522b-dbc3-42bf-8801-b6e755596373: rpc.has_security_group_logging(os_id): False [ 621.163908] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.164077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.164161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.164404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.164502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.164764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.164816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.164887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.165077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.165163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.165353] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.165447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.165523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.165673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.166119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.166407] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.166536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.166680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.166904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.166991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.167104] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 621.248207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.248207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.248207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.248207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.248207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.261037] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 621.482225] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 621.482497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.701441] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.701751] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-292" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.701751] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-292" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.705288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-292" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.705288] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.705288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.705288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.705288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.705288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.705288] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.705288] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.706567] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.706567] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.706567] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.706724] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.710740] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.731462] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.731564] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 621.731662] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.732895] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-292" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.732895] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c6606348-19d1-4a9d-807c-4fdbb90baaad taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.732895] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.732895] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.732895] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.733103] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6606348-19d1-4a9d-807c-4fdbb90baaad',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.748662] env[68828]: INFO networking_nsxv3.common.synchronization [req-c6ca0397-3442-41ff-9268-a86df3b73a32 req-61896bf8-29d8-44e2-b1ad-feecc1f03b07 tempest-SecurityGroupRulesNegativeTestJSON-1632437278 tempest-SecurityGroupRulesNegativeTestJSON-1632437278-project-member] Enqueued Resource ID: aa618863-8a7e-4031-a1a1-59082eb1ce40 with Priority: HIGHEST for action security_group_rules [ 621.749207] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa618863-8a7e-4031-a1a1-59082eb1ce40 with Priority: HIGHEST for action security_group_rules [ 621.751012] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa618863-8a7e-4031-a1a1-59082eb1ce40 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.751012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.751012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.751012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.751012] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa618863-8a7e-4031-a1a1-59082eb1ce40',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.008384] env[68828]: INFO networking_nsxv3.common.synchronization [None req-331a1664-c0e7-40a0-868c-9619a4f78f38 None None] Enqueued Resource ID: 9c2cef7e-11cf-4932-8961-db682797bfa9 with Priority: HIGHEST for action port [ 622.008737] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c2cef7e-11cf-4932-8961-db682797bfa9 with Priority: HIGHEST for action port [ 622.009361] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c2cef7e-11cf-4932-8961-db682797bfa9 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.009478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c2cef7e-11cf-4932-8961-db682797bfa9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.009551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c2cef7e-11cf-4932-8961-db682797bfa9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.013150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c2cef7e-11cf-4932-8961-db682797bfa9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.013725] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c2cef7e-11cf-4932-8961-db682797bfa9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.238166] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.238166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.238166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.238166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.238166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.238361] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c6606348-19d1-4a9d-807c-4fdbb90baaad not found, creating... [ 622.238466] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.238623] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.238736] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.238947] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.239113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.239383] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.239650] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.239650] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.240616] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.240616] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.241267] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c6606348-19d1-4a9d-807c-4fdbb90baaad is going to be created. [ 622.262941] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.263044] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.263258] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.263554] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.263777] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.264011] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.268470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.268612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.268668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.268894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.268955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.269014] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa618863-8a7e-4031-a1a1-59082eb1ce40 already deleted. [ 622.269099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa618863-8a7e-4031-a1a1-59082eb1ce40" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.519547] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c2cef7e-11cf-4932-8961-db682797bfa9 [ 622.519547] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.519547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.519547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.519547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.519547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.519547] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c2cef7e-11cf-4932-8961-db682797bfa9 already deleted. [ 622.519547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c2cef7e-11cf-4932-8961-db682797bfa9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.890148] env[68828]: INFO networking_nsxv3.common.synchronization [None req-de1a68ce-e9cf-4317-820c-7c3c24c9588f None None] Enqueued Resource ID: cc0fed48-b5a4-4882-9fc6-5519f5fc390d with Priority: HIGHEST for action port [ 622.890148] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0fed48-b5a4-4882-9fc6-5519f5fc390d with Priority: HIGHEST for action port [ 622.890543] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0fed48-b5a4-4882-9fc6-5519f5fc390d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.890648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0fed48-b5a4-4882-9fc6-5519f5fc390d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.890703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0fed48-b5a4-4882-9fc6-5519f5fc390d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.891307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0fed48-b5a4-4882-9fc6-5519f5fc390d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.891307] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0fed48-b5a4-4882-9fc6-5519f5fc390d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.278596] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 623.279521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.393680] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc0fed48-b5a4-4882-9fc6-5519f5fc390d [ 623.393811] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.393906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.393962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.394305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.394409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.394463] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc0fed48-b5a4-4882-9fc6-5519f5fc390d already deleted. [ 623.394551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0fed48-b5a4-4882-9fc6-5519f5fc390d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.829012] env[68828]: INFO networking_nsxv3.common.synchronization [req-80a82df1-b48e-4064-9a58-389017182e13 req-52237072-d10b-4599-84dc-37a712538a41 service nova] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_rules [ 623.829197] env[68828]: INFO networking_nsxv3.common.synchronization [req-80a82df1-b48e-4064-9a58-389017182e13 req-52237072-d10b-4599-84dc-37a712538a41 service nova] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_members [ 623.829334] env[68828]: INFO networking_nsxv3.common.synchronization [req-80a82df1-b48e-4064-9a58-389017182e13 req-52237072-d10b-4599-84dc-37a712538a41 service nova] Enqueued Resource ID: c6606348-19d1-4a9d-807c-4fdbb90baaad with Priority: HIGHEST for action port [ 623.829634] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_rules [ 623.829693] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_members [ 623.830054] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6606348-19d1-4a9d-807c-4fdbb90baaad with Priority: HIGHEST for action port [ 623.830732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.830984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.830984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.831243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.831332] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.832657] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.832783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.832852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.833049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.833209] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.833304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.833644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.833644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.833644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.833644] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.836407] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6606348-19d1-4a9d-807c-4fdbb90baaad taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.836525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.836571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.839097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.839097] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6606348-19d1-4a9d-807c-4fdbb90baaad',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.863452] env[68828]: INFO networking_nsxv3.common.synchronization [req-e90315c2-459a-404c-a0b1-60692fe97b5c req-74a89e2d-7c3f-4847-ab2f-f91c7f9606ca tempest-ServerExternalEventsTest-1506754320 tempest-ServerExternalEventsTest-1506754320-project-member] Enqueued Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_members [ 623.866471] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_members [ 623.866559] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.866781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.866917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.867302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.867559] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.867853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.867853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.868583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.868583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.868583] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.252851] env[68828]: INFO networking_nsxv3.common.synchronization [None req-78f46d17-ab54-472f-be9f-f440804578df None None] Enqueued Resource ID: 5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de with Priority: HIGHEST for action port [ 624.253160] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de with Priority: HIGHEST for action port [ 624.253642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.253882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.253882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.254221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.254221] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.334322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.334491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.337524] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.342053] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6606348-19d1-4a9d-807c-4fdbb90baaad with status ACTIVE [ 624.342461] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.342461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.343106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.343106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.343106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.343106] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.343106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.343387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.343387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.343387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.343531] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.343621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.343681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.343816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.343891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.343964] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6606348-19d1-4a9d-807c-4fdbb90baaad is going to be updated. [ 624.367349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.367497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.367569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.367783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.367922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.368116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6606348-19d1-4a9d-807c-4fdbb90baaad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.370571] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.370695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.370752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.371027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.371027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.371299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.371299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.371412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.371508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.371744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.371744] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 already deleted. [ 624.371744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.526843] env[68828]: INFO networking_nsxv3.common.synchronization [None req-f431a331-03d7-4848-b31f-b21d83f10a6b None None] Enqueued Resource ID: e7a13145-cb72-4b90-965e-edcfec389f62 with Priority: HIGHEST for action port [ 624.527124] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a13145-cb72-4b90-965e-edcfec389f62 with Priority: HIGHEST for action port [ 624.527710] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7a13145-cb72-4b90-965e-edcfec389f62 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.527877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7a13145-cb72-4b90-965e-edcfec389f62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.527926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7a13145-cb72-4b90-965e-edcfec389f62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.529461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7a13145-cb72-4b90-965e-edcfec389f62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.529573] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7a13145-cb72-4b90-965e-edcfec389f62',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.690537] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.690537] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.690537] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.690537] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.691446] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.692083] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.692764] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.695020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.695020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.695020] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.695020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.695020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.695020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.695020] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.695020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.695020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.715582] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.715935] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 624.717625] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.717625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.717625] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-b96276cc-0e85-49fd-b843-215b4bd57b8d taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.717945] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.718200] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.719062] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.719302] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96276cc-0e85-49fd-b843-215b4bd57b8d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.758829] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de [ 624.758829] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.758829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.759056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.759999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.760254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.760254] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de already deleted. [ 624.760342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5891e3c6-5e7a-4bc9-9d80-8fe75e41d3de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.840456] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.033418] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7a13145-cb72-4b90-965e-edcfec389f62 [ 625.033622] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.033752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.033820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.034054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.034148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.034243] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7a13145-cb72-4b90-965e-edcfec389f62 already deleted. [ 625.037199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7a13145-cb72-4b90-965e-edcfec389f62" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.222741] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.222962] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.226105] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port b96276cc-0e85-49fd-b843-215b4bd57b8d not found, creating... [ 625.226105] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.226105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.226105] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.226476] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.226476] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.226476] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.226476] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.226476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: b96276cc-0e85-49fd-b843-215b4bd57b8d is going to be created. [ 625.246591] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.246865] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.246922] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.247308] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.247515] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.247706] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.322679] env[68828]: INFO networking_nsxv3.common.synchronization [None req-fb6fd79f-2364-40fd-91f9-d41eda63e3b1 None None] Enqueued Resource ID: b1194205-1298-4b85-8070-c40f2ffb2a9e with Priority: HIGHEST for action port [ 625.323014] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1194205-1298-4b85-8070-c40f2ffb2a9e with Priority: HIGHEST for action port [ 625.325017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1194205-1298-4b85-8070-c40f2ffb2a9e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.325017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1194205-1298-4b85-8070-c40f2ffb2a9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.325017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1194205-1298-4b85-8070-c40f2ffb2a9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.325017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1194205-1298-4b85-8070-c40f2ffb2a9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.325248] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1194205-1298-4b85-8070-c40f2ffb2a9e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.343406] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.346037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.346037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.346037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.346037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.346037] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 is going to be created. [ 625.392396] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.392396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.392396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.392396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.392396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.402816] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f41e17-e083-4115-b3db-6fcd432d4982 in Status: UNINITIALIZED for 2s [ 625.827866] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1194205-1298-4b85-8070-c40f2ffb2a9e [ 625.828259] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.828442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.828481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.828712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.828811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.828916] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1194205-1298-4b85-8070-c40f2ffb2a9e already deleted. [ 625.829015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1194205-1298-4b85-8070-c40f2ffb2a9e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.902597] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e559b3d-ef38-4b45-afdb-48dd9dcf429b req-1bd94cab-8e64-46fd-ab87-10a8ac766269 tempest-ImagesNegativeTestJSON-1612277117 tempest-ImagesNegativeTestJSON-1612277117-project-member] Enqueued Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_members [ 625.902597] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_members [ 625.904297] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.904297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.904297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.904297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.904297] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.904297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.904297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.904297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.904684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.904684] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.406524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.407729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.407729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.407729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.407729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.407729] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.407729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.408253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.408253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.408253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.408253] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a already deleted. [ 626.408253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.442651] env[68828]: INFO networking_nsxv3.common.synchronization [req-e90315c2-459a-404c-a0b1-60692fe97b5c req-1c19eca0-dba4-4c9a-af18-e819be7459d1 service nova] Enqueued Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_rules [ 626.442651] env[68828]: INFO networking_nsxv3.common.synchronization [req-e90315c2-459a-404c-a0b1-60692fe97b5c req-1c19eca0-dba4-4c9a-af18-e819be7459d1 service nova] Enqueued Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_members [ 626.442804] env[68828]: INFO networking_nsxv3.common.synchronization [req-e90315c2-459a-404c-a0b1-60692fe97b5c req-1c19eca0-dba4-4c9a-af18-e819be7459d1 service nova] Enqueued Resource ID: b96276cc-0e85-49fd-b843-215b4bd57b8d with Priority: HIGHEST for action port [ 626.443333] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_rules [ 626.443464] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_members [ 626.443581] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96276cc-0e85-49fd-b843-215b4bd57b8d with Priority: HIGHEST for action port [ 626.443827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.443946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.444125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.444397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.444513] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.445852] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.445967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.446465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.446465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.446465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.446678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.446678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.446796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.447195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.447298] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.448731] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b96276cc-0e85-49fd-b843-215b4bd57b8d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.449800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.449800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.449800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.449800] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96276cc-0e85-49fd-b843-215b4bd57b8d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.542049] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.542049] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.542049] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.542049] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.542049] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.542049] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.542884] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.543232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.543495] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.543804] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.544047] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.544264] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.544469] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.544699] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.544908] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.545147] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.563200] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.564020] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 626.564020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.564020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.564020] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.564366] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.564366] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.564687] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.564687] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('174e9ff6-0ed4-4649-a95a-b4d30143b5c0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.744674] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d24d8807-c6e9-40c9-8e61-63e69b3b11cc tempest-ServersTestManualDisk-1277052254 tempest-ServersTestManualDisk-1277052254-project-member] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_rules [ 626.744854] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_rules [ 626.747245] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.747754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.747754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.748744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.749305] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.949021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.949021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.950460] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.952107] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b96276cc-0e85-49fd-b843-215b4bd57b8d with status ACTIVE [ 626.952665] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.952827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.952927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.953470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.953470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.953470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.953700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.953700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.953811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.953859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.955996] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.956160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.956381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.956478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.956689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.956789] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b96276cc-0e85-49fd-b843-215b4bd57b8d is going to be updated. [ 626.967999] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c8b7c4e8-cec4-4c42-9944-99989962cbf2 tempest-ServersTestManualDisk-1277052254 tempest-ServersTestManualDisk-1277052254-project-member] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_rules [ 626.968647] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_rules [ 626.968937] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.969049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.976997] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.976997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.976997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.977483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.977483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.977483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b96276cc-0e85-49fd-b843-215b4bd57b8d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.072054] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.072054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.072054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.072054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.072054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.072054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 174e9ff6-0ed4-4649-a95a-b4d30143b5c0 not found, creating... [ 627.072569] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.072569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.072697] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.072852] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.072982] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.073280] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.073432] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.073546] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.073898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.073898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.074984] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 174e9ff6-0ed4-4649-a95a-b4d30143b5c0 is going to be created. [ 627.108754] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.108963] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.109109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.109398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.109633] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.109859] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.275432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.275595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.275668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.275901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.275993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.276121] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 already deleted. [ 627.276217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.276373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.276523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.276604] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.418000] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f41e17-e083-4115-b3db-6fcd432d4982 in Status: SUCCESS [ 627.418324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.418439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.419027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.419027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.419027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.419027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.419320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.419320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.419320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.419429] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.452608] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.659369] env[68828]: INFO networking_nsxv3.common.synchronization [None req-76099ee6-7d58-4524-8eb4-102243efbe7b None None] Enqueued Resource ID: fa396b41-57c1-49e4-aba4-6a7408e74005 with Priority: HIGHEST for action port [ 627.659906] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa396b41-57c1-49e4-aba4-6a7408e74005 with Priority: HIGHEST for action port [ 627.660254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa396b41-57c1-49e4-aba4-6a7408e74005 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.660375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa396b41-57c1-49e4-aba4-6a7408e74005" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.660459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa396b41-57c1-49e4-aba4-6a7408e74005" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.660711] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa396b41-57c1-49e4-aba4-6a7408e74005" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.660793] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa396b41-57c1-49e4-aba4-6a7408e74005',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.797584] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.797950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.798532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.798733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.798908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.799202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 already deleted. [ 627.799894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.922801] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.955796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.955991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.955991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.956884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.956884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.956884] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 is going to be created. [ 627.978663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.978663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.978663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.978959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.979136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.989570] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 in Status: UNINITIALIZED for 2s [ 628.140867] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e559b3d-ef38-4b45-afdb-48dd9dcf429b req-16721510-6cb6-4c97-878f-8ff503eb276a service nova] Enqueued Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_rules [ 628.140957] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e559b3d-ef38-4b45-afdb-48dd9dcf429b req-16721510-6cb6-4c97-878f-8ff503eb276a service nova] Enqueued Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_members [ 628.141065] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e559b3d-ef38-4b45-afdb-48dd9dcf429b req-16721510-6cb6-4c97-878f-8ff503eb276a service nova] Enqueued Resource ID: 174e9ff6-0ed4-4649-a95a-b4d30143b5c0 with Priority: HIGHEST for action port [ 628.145037] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_rules [ 628.145037] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_members [ 628.145037] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 174e9ff6-0ed4-4649-a95a-b4d30143b5c0 with Priority: HIGHEST for action port [ 628.145037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.145037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.145037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.145037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.145037] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.145037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.145037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.145037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.145037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.146238] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.146527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.147023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.147289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.147472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.147647] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.148815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.149069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.149222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.149456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.149616] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('174e9ff6-0ed4-4649-a95a-b4d30143b5c0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.166875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa396b41-57c1-49e4-aba4-6a7408e74005 [ 628.166875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.166875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.166875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.166875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.166875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.166875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa396b41-57c1-49e4-aba4-6a7408e74005 already deleted. [ 628.166875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa396b41-57c1-49e4-aba4-6a7408e74005" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.364944] env[68828]: INFO networking_nsxv3.common.synchronization [None req-dba5799d-cc90-4044-bcc2-316f40422137 None None] Enqueued Resource ID: d5abd37b-39ee-41e1-9a80-fef8974bc580 with Priority: HIGHEST for action port [ 628.366888] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5abd37b-39ee-41e1-9a80-fef8974bc580 with Priority: HIGHEST for action port [ 628.367973] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5abd37b-39ee-41e1-9a80-fef8974bc580 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.368205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5abd37b-39ee-41e1-9a80-fef8974bc580" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.368538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5abd37b-39ee-41e1-9a80-fef8974bc580" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.370586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5abd37b-39ee-41e1-9a80-fef8974bc580" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.370766] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5abd37b-39ee-41e1-9a80-fef8974bc580',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.429215] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9f41e17-e083-4115-b3db-6fcd432d4982: rpc.has_security_group_logging(os_id): False [ 628.449131] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.449298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.449345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.449569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.449656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.449901] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.449997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.450095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.450258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.450333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.450420] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 is going to be created. [ 628.510572] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.510776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.510776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.511097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.511321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.523319] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9f41e17-e083-4115-b3db-6fcd432d4982 in Status: IN_PROGRESS for 2s [ 628.657042] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.657042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.657042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.657042] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 174e9ff6-0ed4-4649-a95a-b4d30143b5c0 with status ACTIVE [ 628.657042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.657042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.657042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.657042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.657042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.657042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.657860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.657860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.657860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.657860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.657860] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.657860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.657860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.658110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.658110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.658202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 174e9ff6-0ed4-4649-a95a-b4d30143b5c0 is going to be updated. [ 628.680424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.680424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.680424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.680579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.680772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.680924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-174e9ff6-0ed4-4649-a95a-b4d30143b5c0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.877719] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5abd37b-39ee-41e1-9a80-fef8974bc580 [ 628.879609] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.879782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.879922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.880326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.881097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.881247] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5abd37b-39ee-41e1-9a80-fef8974bc580 already deleted. [ 628.881336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5abd37b-39ee-41e1-9a80-fef8974bc580" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.160772] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.661924] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.662240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.662240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.662806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.662806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.662963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a is going to be created. [ 629.698887] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.699047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.699119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.699327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.699493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.712525] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a in Status: UNINITIALIZED for 2s [ 630.007281] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 in Status: SUCCESS [ 630.007281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.007791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.009664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.012025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.012025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.012170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.012422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.012640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.012706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.013508] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.359176] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c1349d17-d0bd-4fe0-868a-85799823c379 None None] Enqueued Resource ID: 41b1bd4b-7b81-461d-ae14-d1b53620302b with Priority: HIGHEST for action port [ 630.359176] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41b1bd4b-7b81-461d-ae14-d1b53620302b with Priority: HIGHEST for action port [ 630.360257] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-41b1bd4b-7b81-461d-ae14-d1b53620302b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.362373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41b1bd4b-7b81-461d-ae14-d1b53620302b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.362373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41b1bd4b-7b81-461d-ae14-d1b53620302b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.362373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41b1bd4b-7b81-461d-ae14-d1b53620302b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.362373] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b1bd4b-7b81-461d-ae14-d1b53620302b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.518035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.518035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.518035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.518035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.518035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.518911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.518911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.518911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.518911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.518911] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.536448] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9f41e17-e083-4115-b3db-6fcd432d4982 in Status: SUCCESS [ 630.536865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.863513] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41b1bd4b-7b81-461d-ae14-d1b53620302b [ 630.864485] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.864485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.864485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.864643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.864683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.865273] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41b1bd4b-7b81-461d-ae14-d1b53620302b already deleted. [ 630.865273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41b1bd4b-7b81-461d-ae14-d1b53620302b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.026271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d681bb4b-ff28-46df-b3fb-b660a07ce6c2: rpc.has_security_group_logging(os_id): False [ 631.049702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.050398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.050398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.050398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.050751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.050751] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.051902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.051902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.051902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.051902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.051902] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.052162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.052162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.052222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.052268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.054484] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.054484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.054484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.054484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.054484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.054484] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 is going to be created. [ 631.107758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.107758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.107758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.107758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.107758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.119143] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 in Status: IN_PROGRESS for 2s [ 631.725254] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a in Status: SUCCESS [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.725254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.725254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.725254] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.227943] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.228302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.228302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.228565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.228675] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.228758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.228827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.228978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.229074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.229174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.229300] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.229394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.229476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.229617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.229752] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.229841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.229966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.230058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.230177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.230267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.230356] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.500158] env[68828]: INFO networking_nsxv3.common.synchronization [None req-49962e26-80a3-4dfa-9791-e0d82825f6f9 None None] Enqueued Resource ID: dd656f7e-4730-470c-a0d0-f67f81a9ea69 with Priority: HIGHEST for action port [ 632.500305] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd656f7e-4730-470c-a0d0-f67f81a9ea69 with Priority: HIGHEST for action port [ 632.500641] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd656f7e-4730-470c-a0d0-f67f81a9ea69 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.500784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd656f7e-4730-470c-a0d0-f67f81a9ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.500880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd656f7e-4730-470c-a0d0-f67f81a9ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.501464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd656f7e-4730-470c-a0d0-f67f81a9ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.501549] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd656f7e-4730-470c-a0d0-f67f81a9ea69',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.732641] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bfa5a1fe-085f-464d-8f13-c58c1c0ee85a: rpc.has_security_group_logging(os_id): False [ 632.757264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.757264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.757264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.757264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.757846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.757846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.757846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.759273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.759273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.759273] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a is going to be created. [ 632.812021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.814319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.814319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.814319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.814492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.829896] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a in Status: IN_PROGRESS for 2s [ 633.003939] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd656f7e-4730-470c-a0d0-f67f81a9ea69 [ 633.004103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.004214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.004285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.004500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.004594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.004699] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd656f7e-4730-470c-a0d0-f67f81a9ea69 already deleted. [ 633.004763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd656f7e-4730-470c-a0d0-f67f81a9ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.131591] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 in Status: SUCCESS [ 633.131824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.161541] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5425e7fa-feb9-4d13-bba0-bfd9de1695a5 None None] Enqueued Resource ID: 0b5e6215-e168-49a4-9762-dc0974937f7c with Priority: HIGHEST for action port [ 634.161807] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b5e6215-e168-49a4-9762-dc0974937f7c with Priority: HIGHEST for action port [ 634.163893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b5e6215-e168-49a4-9762-dc0974937f7c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.164106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b5e6215-e168-49a4-9762-dc0974937f7c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.164190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b5e6215-e168-49a4-9762-dc0974937f7c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.164403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b5e6215-e168-49a4-9762-dc0974937f7c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.164504] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b5e6215-e168-49a4-9762-dc0974937f7c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.667290] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b5e6215-e168-49a4-9762-dc0974937f7c [ 634.667538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.667670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.667736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.667946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.668058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.668162] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b5e6215-e168-49a4-9762-dc0974937f7c already deleted. [ 634.668244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b5e6215-e168-49a4-9762-dc0974937f7c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.842998] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a in Status: SUCCESS [ 634.843266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.149741] env[68828]: INFO networking_nsxv3.common.synchronization [None req-59885115-2379-4919-aa7e-025d55a70284 None None] Enqueued Resource ID: f3dff150-c5cd-4a49-90f6-68a747d22ef0 with Priority: HIGHEST for action port [ 635.151473] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3dff150-c5cd-4a49-90f6-68a747d22ef0 with Priority: HIGHEST for action port [ 635.151473] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3dff150-c5cd-4a49-90f6-68a747d22ef0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.151473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3dff150-c5cd-4a49-90f6-68a747d22ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.151473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3dff150-c5cd-4a49-90f6-68a747d22ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.151473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3dff150-c5cd-4a49-90f6-68a747d22ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.152391] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3dff150-c5cd-4a49-90f6-68a747d22ef0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.159289] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a5945279-d647-4dd5-839d-d1f3d6b8d05a tempest-ServersTestFqdnHostnames-595117522 tempest-ServersTestFqdnHostnames-595117522-project-member] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_rules [ 635.159897] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_rules [ 635.160044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.160229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.160283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.160495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.161235] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.310608] env[68828]: INFO networking_nsxv3.common.synchronization [None req-366c4da9-6f03-4be5-af26-134bc9a6f5b5 tempest-ServersTestFqdnHostnames-595117522 tempest-ServersTestFqdnHostnames-595117522-project-member] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_rules [ 635.311476] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_rules [ 635.313764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.313764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.655015] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3dff150-c5cd-4a49-90f6-68a747d22ef0 [ 635.655257] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.656843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.656843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.656843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.656843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.656843] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3dff150-c5cd-4a49-90f6-68a747d22ef0 already deleted. [ 635.656843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3dff150-c5cd-4a49-90f6-68a747d22ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.681130] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.681306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.681374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.681577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.681672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.681762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 already deleted. [ 635.681848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.681995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.682169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.682251] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.691336] env[68828]: INFO networking_nsxv3.common.synchronization [req-46483769-9ad1-4de2-8709-6052736c7ca3 req-7e980664-d218-4f84-b4f7-b3861b4eebb8 tempest-ServersWithSpecificFlavorTestJSON-1891684402 tempest-ServersWithSpecificFlavorTestJSON-1891684402-project-member] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 635.694841] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 635.694841] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.694841] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.694841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.694841] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.925811] env[68828]: INFO networking_nsxv3.common.synchronization [None req-37eccd71-c9c5-48e2-a094-3b50916280f8 None None] Enqueued Resource ID: b70951a4-e6e1-4857-979e-3d1529915d0a with Priority: HIGHEST for action port [ 635.925811] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70951a4-e6e1-4857-979e-3d1529915d0a with Priority: HIGHEST for action port [ 635.926378] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70951a4-e6e1-4857-979e-3d1529915d0a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.926558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70951a4-e6e1-4857-979e-3d1529915d0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.926624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70951a4-e6e1-4857-979e-3d1529915d0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.926882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70951a4-e6e1-4857-979e-3d1529915d0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.927169] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70951a4-e6e1-4857-979e-3d1529915d0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.199407] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.200834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.200834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.200834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.200834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.200834] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.201837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.201837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.201989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.202183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.202372] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 already deleted. [ 636.202934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.207845] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.207845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.207845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.207845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.207845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.207845] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 already deleted. [ 636.207845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.430540] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b70951a4-e6e1-4857-979e-3d1529915d0a [ 636.430837] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.430902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.430967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.431221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.431312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.431406] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b70951a4-e6e1-4857-979e-3d1529915d0a already deleted. [ 636.431485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70951a4-e6e1-4857-979e-3d1529915d0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.320769] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.321109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.321349] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.321756] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.322010] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.322180] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.322299] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.322514] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.322775] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.323045] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.323213] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.323475] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.323895] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.324069] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.324216] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.324571] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.342866] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.343193] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 637.343397] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.343681] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.344397] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-2d53b0bd-b22e-471a-abb8-6311e8d1c828 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.344621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.344800] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.345160] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.345474] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d53b0bd-b22e-471a-abb8-6311e8d1c828',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.852028] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.852028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.852028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.852028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.855354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.855354] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 2d53b0bd-b22e-471a-abb8-6311e8d1c828 not found, creating... [ 637.855354] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.855354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.855354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.855354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.855354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.855354] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.859304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.859304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.859304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.859304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.859304] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 2d53b0bd-b22e-471a-abb8-6311e8d1c828 is going to be created. [ 637.879352] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.879635] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.879794] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.880132] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.880367] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.880596] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.232529] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ee1e6613-f9c4-4454-8a14-36246e93a9df None None] Enqueued Resource ID: 3b1d1147-b489-495f-b69a-d1a737e998a7 with Priority: HIGHEST for action port [ 638.234091] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b1d1147-b489-495f-b69a-d1a737e998a7 with Priority: HIGHEST for action port [ 638.237202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b1d1147-b489-495f-b69a-d1a737e998a7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.237355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b1d1147-b489-495f-b69a-d1a737e998a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.237428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b1d1147-b489-495f-b69a-d1a737e998a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.237700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b1d1147-b489-495f-b69a-d1a737e998a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.237787] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b1d1147-b489-495f-b69a-d1a737e998a7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.441232] env[68828]: INFO networking_nsxv3.common.synchronization [None req-fcac2b52-c84d-47c9-a58b-d8337ce45fdb None None] Enqueued Resource ID: d7fb9906-78c5-4aa7-b6d5-bec683020316 with Priority: HIGHEST for action port [ 638.443529] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7fb9906-78c5-4aa7-b6d5-bec683020316 with Priority: HIGHEST for action port [ 638.443529] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7fb9906-78c5-4aa7-b6d5-bec683020316 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.443529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7fb9906-78c5-4aa7-b6d5-bec683020316" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.443529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7fb9906-78c5-4aa7-b6d5-bec683020316" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.443529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7fb9906-78c5-4aa7-b6d5-bec683020316" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.443529] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7fb9906-78c5-4aa7-b6d5-bec683020316',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.739906] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b1d1147-b489-495f-b69a-d1a737e998a7 [ 638.740751] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.740751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.740751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.740751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.740751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.740751] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b1d1147-b489-495f-b69a-d1a737e998a7 already deleted. [ 638.741025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b1d1147-b489-495f-b69a-d1a737e998a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.749762] env[68828]: INFO networking_nsxv3.common.synchronization [req-46483769-9ad1-4de2-8709-6052736c7ca3 req-d98fcd10-63a2-407f-bc41-ce9cf78ee05f service nova] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 638.749957] env[68828]: INFO networking_nsxv3.common.synchronization [req-46483769-9ad1-4de2-8709-6052736c7ca3 req-d98fcd10-63a2-407f-bc41-ce9cf78ee05f service nova] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 638.750154] env[68828]: INFO networking_nsxv3.common.synchronization [req-46483769-9ad1-4de2-8709-6052736c7ca3 req-d98fcd10-63a2-407f-bc41-ce9cf78ee05f service nova] Enqueued Resource ID: 2d53b0bd-b22e-471a-abb8-6311e8d1c828 with Priority: HIGHEST for action port [ 638.750449] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 638.750578] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 638.750668] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d53b0bd-b22e-471a-abb8-6311e8d1c828 with Priority: HIGHEST for action port [ 638.753523] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.754025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.754130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.754920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.755458] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.756399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.756534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.756600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.756781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.756936] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.757041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.758876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.760161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.760453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.760453] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.762962] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d53b0bd-b22e-471a-abb8-6311e8d1c828 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.762962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.762962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.762962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.762962] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d53b0bd-b22e-471a-abb8-6311e8d1c828',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.902025] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a4002858-bff9-46bf-8eaa-f1bf08c71b3e None None] Enqueued Resource ID: d8a21f03-0cb5-4342-b696-ed0eba3be1e5 with Priority: HIGHEST for action port [ 638.902535] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a21f03-0cb5-4342-b696-ed0eba3be1e5 with Priority: HIGHEST for action port [ 638.902939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8a21f03-0cb5-4342-b696-ed0eba3be1e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.903158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8a21f03-0cb5-4342-b696-ed0eba3be1e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.903319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8a21f03-0cb5-4342-b696-ed0eba3be1e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.905189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8a21f03-0cb5-4342-b696-ed0eba3be1e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.906074] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8a21f03-0cb5-4342-b696-ed0eba3be1e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.952301] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7fb9906-78c5-4aa7-b6d5-bec683020316 [ 638.952301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.952301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.952301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.952301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.952301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.952301] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7fb9906-78c5-4aa7-b6d5-bec683020316 already deleted. [ 638.952301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7fb9906-78c5-4aa7-b6d5-bec683020316" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.267761] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.271210] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.271357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.271953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d53b0bd-b22e-471a-abb8-6311e8d1c828 with status ACTIVE [ 639.271953] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.271953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.271953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.272193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.272193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.272416] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.272416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.272543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.272697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.272744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.273439] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.273546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.273620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.273773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.273853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.273939] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d53b0bd-b22e-471a-abb8-6311e8d1c828 is going to be updated. [ 639.293088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.293088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.293088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.293320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.293369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.293511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d53b0bd-b22e-471a-abb8-6311e8d1c828" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.411573] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8a21f03-0cb5-4342-b696-ed0eba3be1e5 [ 639.411864] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.411982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.412097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.412225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.412330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.412431] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8a21f03-0cb5-4342-b696-ed0eba3be1e5 already deleted. [ 639.412588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8a21f03-0cb5-4342-b696-ed0eba3be1e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.771733] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.274970] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.275287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.275287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.276027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.276027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.276027] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be created. [ 640.297235] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.297380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.297454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.297671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.297828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.311253] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: UNINITIALIZED for 2s [ 640.917477] env[68828]: INFO networking_nsxv3.common.synchronization [None req-85c95b0a-7424-4edd-a0fb-9c8f268e7a27 None None] Enqueued Resource ID: 4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39 with Priority: HIGHEST for action port [ 640.917951] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39 with Priority: HIGHEST for action port [ 640.918364] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.918492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.918677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.918808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.918879] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.423440] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39 [ 641.423700] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.423964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.425295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.425295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.425295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.425589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39 already deleted. [ 641.425718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb1b8c8-0bae-4b9f-bdde-52c2fb0a5a39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.626696] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ba108385-de52-4474-9fc1-a43d9429c56d None None] Enqueued Resource ID: be6eae37-c740-4c42-af29-9dd7e8f2d8d4 with Priority: HIGHEST for action port [ 641.627430] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6eae37-c740-4c42-af29-9dd7e8f2d8d4 with Priority: HIGHEST for action port [ 641.627667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-be6eae37-c740-4c42-af29-9dd7e8f2d8d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.627789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be6eae37-c740-4c42-af29-9dd7e8f2d8d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.627857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be6eae37-c740-4c42-af29-9dd7e8f2d8d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.629516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be6eae37-c740-4c42-af29-9dd7e8f2d8d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.629516] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be6eae37-c740-4c42-af29-9dd7e8f2d8d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.660107] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b21b0cda-40b2-4a50-b3d5-95d4367f8d67 None None] Enqueued Resource ID: 652c0b1b-b51d-443d-aec1-0e3296146b6f with Priority: HIGHEST for action port [ 641.660614] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 652c0b1b-b51d-443d-aec1-0e3296146b6f with Priority: HIGHEST for action port [ 641.660918] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-652c0b1b-b51d-443d-aec1-0e3296146b6f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.661102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-652c0b1b-b51d-443d-aec1-0e3296146b6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.661102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-652c0b1b-b51d-443d-aec1-0e3296146b6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.661361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-652c0b1b-b51d-443d-aec1-0e3296146b6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.662014] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652c0b1b-b51d-443d-aec1-0e3296146b6f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.132797] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be6eae37-c740-4c42-af29-9dd7e8f2d8d4 [ 642.133350] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.133350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.133498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.133660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.133788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.134455] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be6eae37-c740-4c42-af29-9dd7e8f2d8d4 already deleted. [ 642.134455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be6eae37-c740-4c42-af29-9dd7e8f2d8d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.165584] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 652c0b1b-b51d-443d-aec1-0e3296146b6f [ 642.167830] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.167830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.167830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.167830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.167830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.167830] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:652c0b1b-b51d-443d-aec1-0e3296146b6f already deleted. [ 642.167830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-652c0b1b-b51d-443d-aec1-0e3296146b6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.323087] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: SUCCESS [ 642.323483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.323670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.323891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.324533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.324687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.324757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.324974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.325034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.325118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.325209] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.828227] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.158166] env[68828]: INFO networking_nsxv3.common.synchronization [req-494acfe3-6330-40b7-91da-d420bb57da8f req-653a7424-0ec8-4146-9bee-c0990c0ef0df tempest-ImagesNegativeTestJSON-1612277117 tempest-ImagesNegativeTestJSON-1612277117-project-member] Enqueued Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_members [ 643.158166] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGHEST for action security_group_members [ 643.158166] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.158166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.158166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.158166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.158166] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.158166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.158166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.158833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.159999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.159999] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.332560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc128506-c5e7-4179-a805-6679a20e9957: rpc.has_security_group_logging(os_id): False [ 643.351319] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.351532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.351532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.352215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.352215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.352215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.352425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.352425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.352629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.352721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.352879] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be created. [ 643.427364] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.427576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.427626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.428037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.428277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.439030] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: IN_PROGRESS for 2s [ 643.662559] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.662734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.662803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.663091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.663129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.663332] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.663427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.663487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.663708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.663708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.663778] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a is going to be updated. [ 643.693971] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.694146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.694205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.694487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.694622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.703466] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a in Status: IN_PROGRESS for 2s [ 644.033065] env[68828]: INFO networking_nsxv3.common.synchronization [req-225e76b1-a8ee-4efc-be2e-ca3930dff19d req-acab6d59-133f-4b95-9f11-68568e6e20b3 tempest-ServersV294TestFqdnHostnames-978881238 tempest-ServersV294TestFqdnHostnames-978881238-project-member] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_members [ 644.033566] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_members [ 644.033859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.033972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.034054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.035830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.035830] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.035830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.036609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.036828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.036920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.037025] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.542064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.542064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.542064] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c already deleted. [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.542064] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-926" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.542064] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-926" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.542751] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-926" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.542751] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.542751] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.542862] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.543097] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.543194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.543416] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.543546] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.543656] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.543762] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.543870] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.543970] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.544112] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.561498] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.561705] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 644.561780] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.561954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-926" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.562289] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c0ab7829-e2f4-42d6-867b-b7cd13202a50 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.562491] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.562904] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.563033] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.563158] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ab7829-e2f4-42d6-867b-b7cd13202a50',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.066602] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.069883] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c0ab7829-e2f4-42d6-867b-b7cd13202a50 not found, creating... [ 645.069883] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.069883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.070304] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.070304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.070304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.070304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.072218] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.072810] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c0ab7829-e2f4-42d6-867b-b7cd13202a50 is going to be created. [ 645.075634] env[68828]: INFO networking_nsxv3.common.synchronization [req-364a06ae-19f7-42f2-9447-4c9903bdef69 req-224a41fc-ed20-4c9e-833b-1831cc43d8c2 tempest-ServerExternalEventsTest-1506754320 tempest-ServerExternalEventsTest-1506754320-project-member] Enqueued Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_members [ 645.076540] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGHEST for action security_group_members [ 645.076831] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.076953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.077054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.077227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.077405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.077508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.077586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.077737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.077822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.077948] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.097598] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.097825] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.097954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.098303] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.098591] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.098811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.103289] env[68828]: INFO networking_nsxv3.common.synchronization [None req-0c4f5453-ada9-42cc-bbca-87a6d195a4f4 None None] Enqueued Resource ID: a07fe84f-067c-4ad4-bbab-4e1e1caf9436 with Priority: HIGHEST for action port [ 645.103746] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a07fe84f-067c-4ad4-bbab-4e1e1caf9436 with Priority: HIGHEST for action port [ 645.104086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-a07fe84f-067c-4ad4-bbab-4e1e1caf9436 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.104211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a07fe84f-067c-4ad4-bbab-4e1e1caf9436" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.104312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a07fe84f-067c-4ad4-bbab-4e1e1caf9436" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.104533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a07fe84f-067c-4ad4-bbab-4e1e1caf9436" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.104617] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a07fe84f-067c-4ad4-bbab-4e1e1caf9436',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.450474] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: SUCCESS [ 645.450696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.581209] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.581575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.581575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.581723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.581805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.582022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.582124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.582213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.585199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.585199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.585199] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 is going to be updated. [ 645.607622] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a07fe84f-067c-4ad4-bbab-4e1e1caf9436 [ 645.607885] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.608029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.608098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.611100] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a07fe84f-067c-4ad4-bbab-4e1e1caf9436 already deleted. [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a07fe84f-067c-4ad4-bbab-4e1e1caf9436" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.611100] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.611100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.619803] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 in Status: IN_PROGRESS for 2s [ 645.716844] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a in Status: SUCCESS [ 645.717049] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a deletion is rescheduled due to dependency. [ 645.717169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.911134] env[68828]: INFO networking_nsxv3.common.synchronization [None req-17d3d271-63f8-4986-a4ac-9798be1036c1 None None] Enqueued Resource ID: 06dfe97c-076f-4280-ae94-034d69442678 with Priority: HIGHEST for action port [ 645.911134] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06dfe97c-076f-4280-ae94-034d69442678 with Priority: HIGHEST for action port [ 645.911134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-06dfe97c-076f-4280-ae94-034d69442678 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.911134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06dfe97c-076f-4280-ae94-034d69442678" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.911134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06dfe97c-076f-4280-ae94-034d69442678" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.912383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06dfe97c-076f-4280-ae94-034d69442678" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.912584] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06dfe97c-076f-4280-ae94-034d69442678',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.971285] env[68828]: INFO networking_nsxv3.common.synchronization [req-225e76b1-a8ee-4efc-be2e-ca3930dff19d req-44a42120-75f4-49d4-933c-f7525861c29b service nova] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_rules [ 645.971285] env[68828]: INFO networking_nsxv3.common.synchronization [req-225e76b1-a8ee-4efc-be2e-ca3930dff19d req-44a42120-75f4-49d4-933c-f7525861c29b service nova] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_members [ 645.971285] env[68828]: INFO networking_nsxv3.common.synchronization [req-225e76b1-a8ee-4efc-be2e-ca3930dff19d req-44a42120-75f4-49d4-933c-f7525861c29b service nova] Enqueued Resource ID: c0ab7829-e2f4-42d6-867b-b7cd13202a50 with Priority: HIGHEST for action port [ 645.971285] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_rules [ 645.971285] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_members [ 645.971285] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ab7829-e2f4-42d6-867b-b7cd13202a50 with Priority: HIGHEST for action port [ 645.971285] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.971285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.971285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.971285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.971727] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.973978] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.973978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.973978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.974328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.974328] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.974328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.974481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.974592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.974640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.974728] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.975854] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0ab7829-e2f4-42d6-867b-b7cd13202a50 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.975854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.975854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.976063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.976114] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ab7829-e2f4-42d6-867b-b7cd13202a50',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.417978] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06dfe97c-076f-4280-ae94-034d69442678 [ 646.417978] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.417978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.417978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.417978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.417978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.417978] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06dfe97c-076f-4280-ae94-034d69442678 already deleted. [ 646.417978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06dfe97c-076f-4280-ae94-034d69442678" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.480310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.480310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.480532] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.483010] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0ab7829-e2f4-42d6-867b-b7cd13202a50 with status ACTIVE [ 646.484038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.484038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.484038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.484038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.484038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.484038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.484940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.484940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.485220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.485220] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0ab7829-e2f4-42d6-867b-b7cd13202a50 is going to be updated. [ 646.507484] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.507484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.507484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.507674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.508112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.508112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0ab7829-e2f4-42d6-867b-b7cd13202a50" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.930809] env[68828]: INFO networking_nsxv3.common.synchronization [req-5386e542-6078-4207-93c5-fb3ca9a8c63f req-d4d96222-303c-4f98-b2b5-bc951654602f tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 646.932135] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 646.932135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.932135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.932135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.933375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.933375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.933375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.933375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.933375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.933375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.933375] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.984248] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.435903] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.436252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.436252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.436412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.436453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.436636] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.436730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.436789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.436942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.437025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.437109] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f already deleted. [ 647.437187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.484842] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.485030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.485116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.485320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.485412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.485527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c is going to be created. [ 647.509118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.509475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.509550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.510405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.510722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.520102] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c in Status: UNINITIALIZED for 2s [ 647.629406] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 in Status: SUCCESS [ 647.629560] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 deletion is rescheduled due to dependency. [ 647.629757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.982878] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.983158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.983233] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.983905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.984472] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.984873] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.985261] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.986448] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.986853] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.987829] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.987829] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.987829] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.987829] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.987829] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.987829] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.988508] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.009300] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.009300] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.009300] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.009300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.009300] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-d6775b90-04dd-477e-9f99-b3e62389c627 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.009300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.009300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.009635] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.009828] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6775b90-04dd-477e-9f99-b3e62389c627',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.152867] env[68828]: INFO networking_nsxv3.common.synchronization [None req-305ee813-c847-4ed3-b3e9-54c2852743f5 None None] Enqueued Resource ID: 7ffaa8a7-75f9-4243-b9e6-c48b915bb415 with Priority: HIGHEST for action port [ 648.153111] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffaa8a7-75f9-4243-b9e6-c48b915bb415 with Priority: HIGHEST for action port [ 648.153989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ffaa8a7-75f9-4243-b9e6-c48b915bb415 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.153989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ffaa8a7-75f9-4243-b9e6-c48b915bb415" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.153989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ffaa8a7-75f9-4243-b9e6-c48b915bb415" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.154241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ffaa8a7-75f9-4243-b9e6-c48b915bb415" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.154336] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffaa8a7-75f9-4243-b9e6-c48b915bb415',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.491019] env[68828]: INFO networking_nsxv3.common.synchronization [None req-fb50103a-2b93-4f36-93e9-0256fefced32 None None] Enqueued Resource ID: b2a7286a-3632-4aa7-96b6-30c5af913bd1 with Priority: HIGHEST for action port [ 648.491019] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2a7286a-3632-4aa7-96b6-30c5af913bd1 with Priority: HIGHEST for action port [ 648.491019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2a7286a-3632-4aa7-96b6-30c5af913bd1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.491019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2a7286a-3632-4aa7-96b6-30c5af913bd1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.491019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2a7286a-3632-4aa7-96b6-30c5af913bd1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.491019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2a7286a-3632-4aa7-96b6-30c5af913bd1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.491019] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a7286a-3632-4aa7-96b6-30c5af913bd1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.514372] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.514372] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.514372] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.514583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.514583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.514708] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port d6775b90-04dd-477e-9f99-b3e62389c627 not found, creating... [ 648.514963] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.515138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.515262] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.515735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.515873] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.516165] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.516469] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.516625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.516840] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.516976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.517133] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: d6775b90-04dd-477e-9f99-b3e62389c627 is going to be created. [ 648.537937] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.538469] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.538562] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.538829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.539068] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.539307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.656262] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ffaa8a7-75f9-4243-b9e6-c48b915bb415 [ 648.656498] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.656635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.656703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.656907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.656993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.657098] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ffaa8a7-75f9-4243-b9e6-c48b915bb415 already deleted. [ 648.657177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ffaa8a7-75f9-4243-b9e6-c48b915bb415" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.993981] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2a7286a-3632-4aa7-96b6-30c5af913bd1 [ 648.994242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.994380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.994453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.994772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.994772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.994866] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2a7286a-3632-4aa7-96b6-30c5af913bd1 already deleted. [ 648.995072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2a7286a-3632-4aa7-96b6-30c5af913bd1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.217156] env[68828]: INFO networking_nsxv3.common.synchronization [req-e04ccc8c-9803-41bf-b9b8-c1a5575ca225 req-2ba5810a-8a5e-48db-9ae8-ca4c9fe2b49d tempest-FloatingIPsAssociationNegativeTestJSON-600040299 tempest-FloatingIPsAssociationNegativeTestJSON-600040299-project-member] Enqueued Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_members [ 649.217690] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_members [ 649.218023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.218158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.218242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.218497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.218662] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.218780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.218839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.219008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.221458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.221560] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.532269] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c in Status: SUCCESS [ 649.532717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.532883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.533171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.533374] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.533495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.533564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.533721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.533806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.533893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.533984] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.537438] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.537685] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-588" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.537845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-588" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.538617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-588" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.539056] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.539271] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.539428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.539675] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.543027] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.543027] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.543027] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.543027] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.543027] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.543027] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.543027] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.543027] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.557391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.557574] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.557709] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.557886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-588" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.558224] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.558402] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.558617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.558945] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.559186] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.723300] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.723692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.723775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.724097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.724197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.724400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.724502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.724594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.724712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.724788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.724875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6547eb98-d904-4822-951d-00fe16de337d already deleted. [ 649.724953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.851801] env[68828]: INFO networking_nsxv3.common.synchronization [req-5386e542-6078-4207-93c5-fb3ca9a8c63f req-8c05a027-8750-415c-abb5-97c9ab520665 service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 649.851801] env[68828]: INFO networking_nsxv3.common.synchronization [req-5386e542-6078-4207-93c5-fb3ca9a8c63f req-8c05a027-8750-415c-abb5-97c9ab520665 service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 649.851801] env[68828]: INFO networking_nsxv3.common.synchronization [req-5386e542-6078-4207-93c5-fb3ca9a8c63f req-8c05a027-8750-415c-abb5-97c9ab520665 service nova] Enqueued Resource ID: d6775b90-04dd-477e-9f99-b3e62389c627 with Priority: HIGHEST for action port [ 649.851801] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 649.851801] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 649.851801] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6775b90-04dd-477e-9f99-b3e62389c627 with Priority: HIGHEST for action port [ 649.851801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.851801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.851801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.851801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.852184] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.854064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.854064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.854064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.854831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.854831] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.854831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.854831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.854831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.855658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.855851] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.858682] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6775b90-04dd-477e-9f99-b3e62389c627 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.858682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.858682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.858682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.861097] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6775b90-04dd-477e-9f99-b3e62389c627',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.036478] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.062198] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.063416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.063416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.063416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.063416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.063416] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 not found, creating... [ 650.063627] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.063796] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.063839] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.064038] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.064182] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.064459] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.064602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.064719] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.065150] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.065150] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.065260] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 is going to be created. [ 650.107759] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.108083] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.108343] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.108481] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.108708] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.108936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.363962] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.363962] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.363962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.364540] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6775b90-04dd-477e-9f99-b3e62389c627 with status ACTIVE [ 650.364789] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.364977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.365217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.365550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.365731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.366589] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.366800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.366946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.367257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.367703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.368034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.368240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.368431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.368686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.368877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.369274] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6775b90-04dd-477e-9f99-b3e62389c627 is going to be updated. [ 650.393140] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.393140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.393140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.393344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.393594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.393925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6775b90-04dd-477e-9f99-b3e62389c627" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.539112] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c: rpc.has_security_group_logging(os_id): False [ 650.559999] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.559999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.559999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.559999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.559999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.559999] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.560312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.560312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.560389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.560452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.560539] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c is going to be created. [ 650.632117] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.632289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.632362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.632626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.632840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.645098] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c in Status: IN_PROGRESS for 2s [ 650.855486] env[68828]: INFO networking_nsxv3.common.synchronization [req-e04ccc8c-9803-41bf-b9b8-c1a5575ca225 req-48ea5849-c5a8-440b-849d-50d94e07216a service nova] Enqueued Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_rules [ 650.855486] env[68828]: INFO networking_nsxv3.common.synchronization [req-e04ccc8c-9803-41bf-b9b8-c1a5575ca225 req-48ea5849-c5a8-440b-849d-50d94e07216a service nova] Enqueued Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_members [ 650.855614] env[68828]: INFO networking_nsxv3.common.synchronization [req-e04ccc8c-9803-41bf-b9b8-c1a5575ca225 req-48ea5849-c5a8-440b-849d-50d94e07216a service nova] Enqueued Resource ID: b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 with Priority: HIGHEST for action port [ 650.859344] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_rules [ 650.859871] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_members [ 650.860176] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 with Priority: HIGHEST for action port [ 650.860893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.860893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.860893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.861381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.861512] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.863453] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.863453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.863453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.863724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.863951] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.864258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.864319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.864547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.864715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.865180] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.868090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.868090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.868090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.868090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.868090] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.869809] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.152194] env[68828]: INFO networking_nsxv3.common.synchronization [None req-69875b7a-67d4-4fd6-8841-01e164b1e2f6 None None] Enqueued Resource ID: 42a970d2-0e75-49ff-a0e2-d28389c18a1d with Priority: HIGHEST for action port [ 651.152295] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a970d2-0e75-49ff-a0e2-d28389c18a1d with Priority: HIGHEST for action port [ 651.153158] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a970d2-0e75-49ff-a0e2-d28389c18a1d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.153289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a970d2-0e75-49ff-a0e2-d28389c18a1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.153356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a970d2-0e75-49ff-a0e2-d28389c18a1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.153608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a970d2-0e75-49ff-a0e2-d28389c18a1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.153685] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a970d2-0e75-49ff-a0e2-d28389c18a1d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.370689] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.372537] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.372669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.372855] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 with status ACTIVE [ 651.373054] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.373169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.373235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.373438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.373529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.373690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.373784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.373846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.373999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.376113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.376313] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.376415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.376483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.376632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.376713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.376798] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1 is going to be updated. [ 651.377907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.378017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.378088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.378240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.378373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.378419] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be created. [ 651.401875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.402050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.402130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.402361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.402510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.402673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5b13f8c-fc00-4ccb-8bc0-42fd1ade08f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.403519] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.403628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.403695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.403849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.403975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.413306] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: UNINITIALIZED for 2s [ 651.657691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42a970d2-0e75-49ff-a0e2-d28389c18a1d [ 651.657691] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.657691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.657691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.657691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.657691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.657691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42a970d2-0e75-49ff-a0e2-d28389c18a1d already deleted. [ 651.657691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a970d2-0e75-49ff-a0e2-d28389c18a1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.873428] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.996145] env[68828]: INFO networking_nsxv3.common.synchronization [req-b33e1187-7373-42d6-9e40-518d165616bd req-cc40013d-0c07-43f9-a224-491b297785a8 tempest-FloatingIPsAssociationTestJSON-1635333144 tempest-FloatingIPsAssociationTestJSON-1635333144-project-member] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 651.996145] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 651.996145] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.997033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.997033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.997178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.997264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.997394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.997457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.997611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.997698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.997791] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.330638] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-975 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.330919] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.330998] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.331229] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.331562] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.331735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.331861] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.336165] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.336386] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.336666] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.336847] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.336984] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.337115] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.337316] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.337455] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.337627] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.355643] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.355767] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.355921] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.356112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-975" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.356474] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-81d3521b-ad40-4143-b00b-30429f4168b5 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.356693] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.356791] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.357351] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.357582] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d3521b-ad40-4143-b00b-30429f4168b5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.376371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.376371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.376371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.376371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.376886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.376886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6547eb98-d904-4822-951d-00fe16de337d is going to be created. [ 652.411246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.411589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.411814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.413085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.413085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.423781] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6547eb98-d904-4822-951d-00fe16de337d in Status: UNINITIALIZED for 2s [ 652.500206] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.661018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c in Status: SUCCESS [ 652.661018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.865584] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.865684] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.865829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.866066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.866220] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.866383] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 81d3521b-ad40-4143-b00b-30429f4168b5 not found, creating... [ 652.866691] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.866812] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.866907] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.867146] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.867306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.867612] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.867771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.867888] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.871036] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.871036] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.871036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 81d3521b-ad40-4143-b00b-30429f4168b5 is going to be created. [ 652.888941] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.889796] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.889796] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.890032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.890992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.891928] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.002348] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.045414] env[68828]: INFO networking_nsxv3.common.synchronization [None req-91291788-a2b6-4779-8074-10f6a74a46dc None None] Enqueued Resource ID: 005f08a5-e795-4f96-a159-7e4976836e8e with Priority: HIGHEST for action port [ 653.045651] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005f08a5-e795-4f96-a159-7e4976836e8e with Priority: HIGHEST for action port [ 653.046620] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-005f08a5-e795-4f96-a159-7e4976836e8e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.046833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-005f08a5-e795-4f96-a159-7e4976836e8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.046914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-005f08a5-e795-4f96-a159-7e4976836e8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.047217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-005f08a5-e795-4f96-a159-7e4976836e8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.047314] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('005f08a5-e795-4f96-a159-7e4976836e8e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.425029] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 653.425263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.425468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.425639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.425827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.425945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.426021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.426178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.426274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.426516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.426516] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.508079] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.508430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.508543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.508825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.508959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.509145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be updated. [ 653.534935] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.535645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.535645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.535645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.535645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.544556] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 2s [ 653.551096] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 005f08a5-e795-4f96-a159-7e4976836e8e [ 653.551258] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.551401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.551497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.551719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.551813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.551913] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:005f08a5-e795-4f96-a159-7e4976836e8e already deleted. [ 653.551996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-005f08a5-e795-4f96-a159-7e4976836e8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.607658] env[68828]: INFO networking_nsxv3.common.synchronization [req-b33e1187-7373-42d6-9e40-518d165616bd req-57d26778-1f72-4e7f-9af0-1eda5cf6c93e service nova] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_rules [ 653.607841] env[68828]: INFO networking_nsxv3.common.synchronization [req-b33e1187-7373-42d6-9e40-518d165616bd req-57d26778-1f72-4e7f-9af0-1eda5cf6c93e service nova] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 653.607995] env[68828]: INFO networking_nsxv3.common.synchronization [req-b33e1187-7373-42d6-9e40-518d165616bd req-57d26778-1f72-4e7f-9af0-1eda5cf6c93e service nova] Enqueued Resource ID: 81d3521b-ad40-4143-b00b-30429f4168b5 with Priority: HIGHEST for action port [ 653.608972] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_rules [ 653.610893] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 653.610893] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81d3521b-ad40-4143-b00b-30429f4168b5 with Priority: HIGHEST for action port [ 653.611123] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.611123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.611215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.611380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.611488] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.612814] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.612919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.613128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-81d3521b-ad40-4143-b00b-30429f4168b5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.613230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.613293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.613481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.613559] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d3521b-ad40-4143-b00b-30429f4168b5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.929287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.929287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.929287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.929287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.929287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.929287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.929287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.929287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.929904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.929904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.929904] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.930267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.930983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.931285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.931874] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.931874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.931874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.931874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.931874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.931874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.932240] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.120221] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.120378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.120604] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81d3521b-ad40-4143-b00b-30429f4168b5 with status ACTIVE [ 654.120763] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.120877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.120949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.121213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.121317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.121530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.121645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.121717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.121897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.121979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.122359] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.122359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.122565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.122565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.122681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.122742] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81d3521b-ad40-4143-b00b-30429f4168b5 is going to be updated. [ 654.144543] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.144750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.144750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.144972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.145099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.145266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81d3521b-ad40-4143-b00b-30429f4168b5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.427090] env[68828]: INFO networking_nsxv3.common.synchronization [req-0ddc48c3-87da-4a98-9cfd-e4368eaa8498 req-037a03f8-c450-4282-972d-13399a8a939f tempest-ServerTagsTestJSON-873036267 tempest-ServerTagsTestJSON-873036267-project-member] Enqueued Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_members [ 654.428610] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_members [ 654.429010] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.429198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.429293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.429583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.429764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.429873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.429955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.430232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.430307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.430448] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.434885] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fb8087b-3cde-4101-b157-953a51b3561f: rpc.has_security_group_logging(os_id): False [ 654.440514] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6547eb98-d904-4822-951d-00fe16de337d in Status: SUCCESS [ 654.440903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.442268] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.442268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.442268] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.450747] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.451000] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.451055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.451400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.451468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.451953] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.451953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.451953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.452139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.452223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.452433] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.452603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.452658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.452818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.452927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.453183] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.454913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.454913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.454913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.454913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.454913] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be created. [ 654.506630] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.506827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.506899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.507090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.507335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.523953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 654.936405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.936405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.936405] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e already deleted. [ 654.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.948018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.948018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.948018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.948018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.948018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.948825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.948825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.948825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.948825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.948825] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.324039] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.324039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-751" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.324039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-751" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.324039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-751" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.324039] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.324039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.324039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.325158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.325460] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.325821] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.326240] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.326928] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.327227] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.327493] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.327710] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.328160] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.352762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.352762] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.352762] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.352762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-751" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.352762] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-32d8a373-3073-4c08-b091-064dc5bbed2e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.352762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.352762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.352762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.352762] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d8a373-3073-4c08-b091-064dc5bbed2e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.450469] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6547eb98-d904-4822-951d-00fe16de337d: rpc.has_security_group_logging(os_id): False [ 655.471298] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.471298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.471298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.471298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.471545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.472182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.472339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.472573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.473577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.473708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.473949] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.474100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.474213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.474575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.474700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.478308] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.478308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.478308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.478308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.478308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.478308] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6547eb98-d904-4822-951d-00fe16de337d is going to be created. [ 655.531291] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.531574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.531620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.531837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.532030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.544060] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6547eb98-d904-4822-951d-00fe16de337d in Status: IN_PROGRESS for 2s [ 655.556145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 655.557247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.557416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.557642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.557846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.557966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.558752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.558985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.559093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.559198] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.856274] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.856458] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.856596] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.857494] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.857494] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.857494] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 32d8a373-3073-4c08-b091-064dc5bbed2e not found, creating... [ 655.857755] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.857816] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.857961] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.858194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.858364] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.862409] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.862510] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.863958] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.863958] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.863958] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.863958] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 32d8a373-3073-4c08-b091-064dc5bbed2e is going to be created. [ 655.884202] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.884515] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.884643] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.884972] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.885195] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.885465] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.063738] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.534846] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 656.535111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.565651] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.978560] env[68828]: INFO networking_nsxv3.common.synchronization [req-0ddc48c3-87da-4a98-9cfd-e4368eaa8498 req-fd5959ff-abf4-47fd-bc5d-a0b69de34474 service nova] Enqueued Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_rules [ 656.978733] env[68828]: INFO networking_nsxv3.common.synchronization [req-0ddc48c3-87da-4a98-9cfd-e4368eaa8498 req-fd5959ff-abf4-47fd-bc5d-a0b69de34474 service nova] Enqueued Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_members [ 656.979350] env[68828]: INFO networking_nsxv3.common.synchronization [req-0ddc48c3-87da-4a98-9cfd-e4368eaa8498 req-fd5959ff-abf4-47fd-bc5d-a0b69de34474 service nova] Enqueued Resource ID: 32d8a373-3073-4c08-b091-064dc5bbed2e with Priority: HIGHEST for action port [ 656.979492] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_rules [ 656.979681] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_members [ 656.979807] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d8a373-3073-4c08-b091-064dc5bbed2e with Priority: HIGHEST for action port [ 656.984658] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.984741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.984849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.985305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.985305] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.988617] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.988617] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.988617] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.988617] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-32d8a373-3073-4c08-b091-064dc5bbed2e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.988617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.988617] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d8a373-3073-4c08-b091-064dc5bbed2e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.068684] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.068987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.068987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.070043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.070043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.070043] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be updated. [ 657.121461] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.121741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.121741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.122826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.122826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.143601] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 2s [ 657.490575] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32d8a373-3073-4c08-b091-064dc5bbed2e with status ACTIVE [ 657.490725] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.490882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.490956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.491183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.491278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.491497] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.491555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.491635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.491770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.491849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.492119] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.492119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.492230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.492315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.492432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.492492] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32d8a373-3073-4c08-b091-064dc5bbed2e is going to be updated. [ 657.493954] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.493954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.494135] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.513693] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.513941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.513941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.514144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.514277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.514639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32d8a373-3073-4c08-b091-064dc5bbed2e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.563196] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6547eb98-d904-4822-951d-00fe16de337d in Status: SUCCESS [ 657.563425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.996600] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.500891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.501191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.501191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.501405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.502055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.502055] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e is going to be created. [ 658.525307] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.525464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.525538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.525757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.526100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.536045] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e in Status: UNINITIALIZED for 2s [ 659.157354] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.157354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.157354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.157354] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.327215] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b96292f8-7254-47d9-b2a5-6f206a876011 None None] Enqueued Resource ID: 05faa931-a640-4b38-ad3f-5a7e762ad5ec with Priority: HIGHEST for action port [ 659.327215] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05faa931-a640-4b38-ad3f-5a7e762ad5ec with Priority: HIGHEST for action port [ 659.327320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-05faa931-a640-4b38-ad3f-5a7e762ad5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.327388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05faa931-a640-4b38-ad3f-5a7e762ad5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.327427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05faa931-a640-4b38-ad3f-5a7e762ad5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.327708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05faa931-a640-4b38-ad3f-5a7e762ad5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.327783] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05faa931-a640-4b38-ad3f-5a7e762ad5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.660315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.660640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.660742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.664026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.664026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664026] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.831153] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05faa931-a640-4b38-ad3f-5a7e762ad5ec [ 659.831242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.831391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.831460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.831670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.831796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.831891] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05faa931-a640-4b38-ad3f-5a7e762ad5ec already deleted. [ 659.831988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05faa931-a640-4b38-ad3f-5a7e762ad5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.146763] env[68828]: INFO networking_nsxv3.common.synchronization [req-abc2e624-78a5-47c0-aee4-8a07b0bddb58 req-8b2a1d49-beea-404c-8eda-889220c42230 tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 660.147306] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 660.148169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.148169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.148169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.148169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.149097] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.149097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.149097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.149842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.149842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.149842] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.169330] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d71fe85b-2b15-476f-8dc2-6739692bced0: rpc.has_security_group_logging(os_id): False [ 660.191504] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.191698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.191698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.191852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.191976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.192768] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.192768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.192768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.192768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.192768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.192768] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.192768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.193151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.193151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.193151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.193242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.193395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.193395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.193972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.193972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.193972] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be updated. [ 660.270889] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.270889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.271071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.271969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.271969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.287977] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 2s [ 660.486375] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-165 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.486592] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.486762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.486977] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.487258] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.487419] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.487533] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.487745] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.487881] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.488208] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.488417] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.488497] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.488557] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.488669] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.488780] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.489425] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.507297] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.507480] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.507663] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.507847] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.508933] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.508933] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.508933] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.508933] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.509256] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce7b072-7aca-46d9-b8b4-63b0f79e8283',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.547022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e in Status: SUCCESS [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.548243] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.548243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.548597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.548597] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.654107] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.013153] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.013153] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.013771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.013771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.013771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.013928] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 8ce7b072-7aca-46d9-b8b4-63b0f79e8283 not found, creating... [ 661.014144] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.015112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.015112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.015112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.015112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.016033] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.016513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.016513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.016665] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.016806] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.016994] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 8ce7b072-7aca-46d9-b8b4-63b0f79e8283 is going to be created. [ 661.039331] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.039866] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.039997] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.040440] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.040570] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.040885] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.050690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.050918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.050993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.051304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.051499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.051499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.051824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.051824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.051824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.052085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.052085] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.052172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.052212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.054312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.054312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.054312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.054312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.054312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.054312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.054312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.054312] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.165475] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.557960] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4b3f009-4ef7-4a2c-9670-9235fef4370e: rpc.has_security_group_logging(os_id): False [ 661.576059] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.576310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.576420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.576595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.576692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.576908] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.577026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.577091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.577250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.577332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.577519] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.577618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.577711] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.577886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.577989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.578236] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.578351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.578419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.578567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.578644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.578729] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e is going to be created. [ 661.634195] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.634381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.634433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.634656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.634858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.649428] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e in Status: IN_PROGRESS for 2s [ 661.669174] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.669332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.669569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.669635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.669713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.669817] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 661.695465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.695608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.695657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.695890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.695974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.704228] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 661.733312] env[68828]: INFO networking_nsxv3.common.synchronization [req-abc2e624-78a5-47c0-aee4-8a07b0bddb58 req-7d6d1d15-2d0d-4cb4-a395-e460712a2e18 service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 661.733312] env[68828]: INFO networking_nsxv3.common.synchronization [req-abc2e624-78a5-47c0-aee4-8a07b0bddb58 req-7d6d1d15-2d0d-4cb4-a395-e460712a2e18 service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 661.733312] env[68828]: INFO networking_nsxv3.common.synchronization [req-abc2e624-78a5-47c0-aee4-8a07b0bddb58 req-7d6d1d15-2d0d-4cb4-a395-e460712a2e18 service nova] Enqueued Resource ID: 8ce7b072-7aca-46d9-b8b4-63b0f79e8283 with Priority: HIGHEST for action port [ 661.733312] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 661.733312] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 661.733312] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ce7b072-7aca-46d9-b8b4-63b0f79e8283 with Priority: HIGHEST for action port [ 661.733312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.733312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.733312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.734306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.734545] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.735774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.735984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.737469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.737469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.737469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.737469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.737469] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce7b072-7aca-46d9-b8b4-63b0f79e8283',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.010442] env[68828]: INFO networking_nsxv3.common.synchronization [None req-8ecb025e-60a4-44d0-ad29-2ebe37ff7104 None None] Enqueued Resource ID: c628fa59-259f-4291-9473-0b48ef0b101f with Priority: HIGHEST for action port [ 662.011020] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c628fa59-259f-4291-9473-0b48ef0b101f with Priority: HIGHEST for action port [ 662.011334] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c628fa59-259f-4291-9473-0b48ef0b101f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.011468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c628fa59-259f-4291-9473-0b48ef0b101f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.011532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c628fa59-259f-4291-9473-0b48ef0b101f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.011802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c628fa59-259f-4291-9473-0b48ef0b101f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.011886] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c628fa59-259f-4291-9473-0b48ef0b101f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.241777] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.242128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.242170] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ce7b072-7aca-46d9-b8b4-63b0f79e8283 with status ACTIVE [ 662.242346] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.242464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.242534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.242743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.242827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.243020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.243123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.243203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.243382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.243433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.243629] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.243727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.243824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.243946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.244039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.244123] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ce7b072-7aca-46d9-b8b4-63b0f79e8283 is going to be updated. [ 662.267889] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.268074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.268126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.268339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.268979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.268979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ce7b072-7aca-46d9-b8b4-63b0f79e8283" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.301863] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 662.302196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.522096] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c628fa59-259f-4291-9473-0b48ef0b101f [ 662.522432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.522589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.522662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.523016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.523016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.523131] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c628fa59-259f-4291-9473-0b48ef0b101f already deleted. [ 662.523201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c628fa59-259f-4291-9473-0b48ef0b101f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.682924] env[68828]: INFO networking_nsxv3.common.synchronization [req-60b76942-9c3f-4920-a2f5-e41ba701f154 req-696dfd2d-bf74-425c-9e8f-2d519e8b50e6 tempest-ServersNegativeTestJSON-1274465967 tempest-ServersNegativeTestJSON-1274465967-project-member] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 662.683539] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 662.683859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.684012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.684305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.684659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.684832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.685875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.685948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.686140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.686231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.686367] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.154994] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.155196] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.155701] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.155701] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.156058] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.156058] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.156200] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.156385] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.156530] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.156739] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.156855] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.156964] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.161229] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.161378] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.161501] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.161648] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.183713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.183713] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 663.183713] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.183713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.183713] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-d68144d4-a58b-4c9f-8b7b-e931045215f6 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.183984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.183984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.184368] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.184960] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68144d4-a58b-4c9f-8b7b-e931045215f6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.213336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.213336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.213336] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 already deleted. [ 663.213336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.662950] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e in Status: SUCCESS [ 663.663236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.686475] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.686740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.687080] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.687524] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.687725] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.687944] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port d68144d4-a58b-4c9f-8b7b-e931045215f6 not found, creating... [ 663.688854] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.693254] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.693555] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.693850] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.694033] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.694390] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.694574] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.694704] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.694954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.695123] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.695273] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 is going to be created. [ 663.713127] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 4s [ 663.714878] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.715158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.715277] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.715486] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.715715] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.715937] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.905581] env[68828]: INFO networking_nsxv3.common.synchronization [None req-49861dc3-f451-45c8-85c2-a834f350ca66 tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_rules [ 663.906222] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_rules [ 663.906450] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.906643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.906729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.906969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.907068] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.992496] env[68828]: INFO networking_nsxv3.common.synchronization [None req-e6e8b698-6345-41d1-a16e-e0ce50ead428 tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_rules [ 663.993099] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_rules [ 663.993790] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.993790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.391677] env[68828]: INFO networking_nsxv3.common.synchronization [req-60b76942-9c3f-4920-a2f5-e41ba701f154 req-9051d0ba-d99a-49c1-99b4-fdda6715eaba service nova] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_rules [ 664.391849] env[68828]: INFO networking_nsxv3.common.synchronization [req-60b76942-9c3f-4920-a2f5-e41ba701f154 req-9051d0ba-d99a-49c1-99b4-fdda6715eaba service nova] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 664.391987] env[68828]: INFO networking_nsxv3.common.synchronization [req-60b76942-9c3f-4920-a2f5-e41ba701f154 req-9051d0ba-d99a-49c1-99b4-fdda6715eaba service nova] Enqueued Resource ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 with Priority: HIGHEST for action port [ 664.392481] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_rules [ 664.392656] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 664.392779] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 with Priority: HIGHEST for action port [ 664.392971] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.393244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.393316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.393597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.393685] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.397098] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.397098] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.397098] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.397098] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d68144d4-a58b-4c9f-8b7b-e931045215f6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.397098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.397098] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68144d4-a58b-4c9f-8b7b-e931045215f6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.431251] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.431404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.431509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.431745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.431844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.431946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 already deleted. [ 664.432041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.432190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.432350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.432433] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.896287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.896669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.901091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d68144d4-a58b-4c9f-8b7b-e931045215f6 with status ACTIVE [ 664.901308] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.901437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.901504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.901715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.901807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.901980] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.902097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.902159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.902315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.902395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.902574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.902672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.902735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.902910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.902990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.903085] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 is going to be updated. [ 664.904317] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.924417] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.924564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.924673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.924824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.924960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.925140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.953134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.953227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.953290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.953484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.953576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.953672] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 already deleted. [ 664.953754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.410620] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.448128] env[68828]: INFO networking_nsxv3.common.synchronization [req-2bdd5e6d-62cf-4f49-8fef-6eed5e592ad3 req-b9323feb-207a-4088-b6d6-6bdfcaf24a4b tempest-DeleteServersAdminTestJSON-483334800 tempest-DeleteServersAdminTestJSON-483334800-project-member] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 665.448621] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 665.448916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.449051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.449119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.449318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.449468] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.449563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.449625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.449770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.449854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.449946] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.725055] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 665.725424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.725873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.726111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.726301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.726422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.726490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.726654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.726773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.727166] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.908116] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.908585] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.908585] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.908936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.909171] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.909343] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.909996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.910281] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.910472] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.910701] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.910820] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.910929] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.911053] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.911166] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.911270] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.911401] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.912942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.913216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.913301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.913606] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.913709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.913985] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be created. [ 665.934500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.934677] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.934815] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.935016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.935335] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.935511] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.935632] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.935979] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.936150] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d24b8c9-ad44-4e9c-9c83-083706c1ad65',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.938190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.938351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.938459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.938659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.938800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.949661] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: UNINITIALIZED for 2s [ 665.955755] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.955897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.955973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.956198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.956289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.956479] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.956593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.956641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.956801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.956855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.956938] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be updated. [ 665.985862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.986087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.986198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.986421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.986560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.997111] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: IN_PROGRESS for 2s [ 666.235839] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.441929] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.442198] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.442327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.442618] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.442790] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.442959] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 0d24b8c9-ad44-4e9c-9c83-083706c1ad65 not found, creating... [ 666.443252] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.443408] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.443582] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.443746] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.443898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.444199] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.444357] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.444551] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.444685] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.444819] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.444959] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 0d24b8c9-ad44-4e9c-9c83-083706c1ad65 is going to be created. [ 666.466645] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.466864] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.466988] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.467295] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.467524] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.467757] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.738436] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.233309] env[68828]: INFO networking_nsxv3.common.synchronization [req-2bdd5e6d-62cf-4f49-8fef-6eed5e592ad3 req-80be5f86-9078-447f-bdd7-6cb0ed5c0ab5 service nova] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_rules [ 667.233671] env[68828]: INFO networking_nsxv3.common.synchronization [req-2bdd5e6d-62cf-4f49-8fef-6eed5e592ad3 req-80be5f86-9078-447f-bdd7-6cb0ed5c0ab5 service nova] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 667.233783] env[68828]: INFO networking_nsxv3.common.synchronization [req-2bdd5e6d-62cf-4f49-8fef-6eed5e592ad3 req-80be5f86-9078-447f-bdd7-6cb0ed5c0ab5 service nova] Enqueued Resource ID: 0d24b8c9-ad44-4e9c-9c83-083706c1ad65 with Priority: HIGHEST for action port [ 667.234471] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_rules [ 667.234676] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 667.234843] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d24b8c9-ad44-4e9c-9c83-083706c1ad65 with Priority: HIGHEST for action port [ 667.236989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.237204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.237320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.237589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.237702] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.238671] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.238780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.239455] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.239614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.239662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.239885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.239984] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d24b8c9-ad44-4e9c-9c83-083706c1ad65',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.242649] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.243221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.243356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.244202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.244435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.244573] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 667.272308] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.272552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.272635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.272894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.273066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.282812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 667.742702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.742702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.742702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d24b8c9-ad44-4e9c-9c83-083706c1ad65 with status ACTIVE [ 667.742901] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.743230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.743230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.743286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.743367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.743545] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.743638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.743700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.743851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.743927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.744114] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.744327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.744327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.744404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.744474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.744643] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d24b8c9-ad44-4e9c-9c83-083706c1ad65 is going to be updated. [ 667.763828] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.763964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.764038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.764234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.764363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.767651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d24b8c9-ad44-4e9c-9c83-083706c1ad65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.961449] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.961449] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.961449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.961449] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.007582] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 668.007582] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d deletion is rescheduled due to dependency. [ 668.007582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.007582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.007784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.008940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.008940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.008940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.008940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.008940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.008940] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.466020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.466020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.466020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.466020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.466720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.466720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.466720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.466720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.466720] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.511586] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.972887] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49bff80d-9c54-4a44-a1a9-f388114a1a64: rpc.has_security_group_logging(os_id): False [ 668.991930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.991930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.991930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.992254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.992254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.992254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.992254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.992402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.992804] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.992899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.992930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.993468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.994018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.994018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be created. [ 669.014162] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.054712] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.054882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.054954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.055208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.055405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.067990] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 669.297520] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 669.297810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.298457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.298686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.298886] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.299063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.299137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.299342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.299389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.299470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.299564] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.518027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.518027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.518971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.523133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.523133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.523133] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be updated. [ 669.550845] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.550845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.550845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.550845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.550845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.562019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: IN_PROGRESS for 2s [ 669.803408] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.803587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.803625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.803847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.804038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.804144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.804210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.804359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.804449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.804538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.804875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.805068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.805113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.805307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.805452] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.805549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.805629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.806309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.806415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.806811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.806811] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.309316] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6a0522b-dbc3-42bf-8801-b6e755596373: rpc.has_security_group_logging(os_id): False [ 670.325599] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.325752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.325824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.326055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.326153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.326383] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.326489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.326647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.326714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.326794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.326971] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.327085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.327150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.327291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.327367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.327562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.327659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.327722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.327863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.327940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.328040] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 670.401589] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.401759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.401869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.404769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.404769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.423115] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 671.080634] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 671.081085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.571680] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 671.571854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.572068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.573705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.573705] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.573705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.573705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.573705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.573705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.573705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.573705] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.075644] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.075970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.075970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.076230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.076315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.076415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.076481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.076633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.076719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.076818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.076964] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.077070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.077128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.077277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.077408] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.077499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.077563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.077700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.077806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.077900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.077983] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.236474] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 672.236474] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 672.439559] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 672.440249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.580515] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 185198c9-6b76-40ca-9634-3cee48a72a6d: rpc.has_security_group_logging(os_id): False [ 672.607664] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.607900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.607977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.608248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.608382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.608683] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.608824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.608916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.609170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.614025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.614025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.614025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.614025] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be updated. [ 672.677188] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.678366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.681111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.681111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.681111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.691342] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: IN_PROGRESS for 2s [ 673.014039] env[68828]: INFO networking_nsxv3.common.synchronization [req-b51cb6c9-9222-4bbc-9946-01dada637666 req-efe04706-03d7-4966-9f6c-46d8d8bb36e4 tempest-ServersTestManualDisk-1277052254 tempest-ServersTestManualDisk-1277052254-project-member] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_members [ 673.014727] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_members [ 673.014848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.015084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.015084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.015336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.015513] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.015691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.015691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.016104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.016104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.016473] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.521118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.521118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.521118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 already deleted. [ 673.521118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.590120] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.590120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-145" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.590120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-145" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.590120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-145" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.590120] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.590120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.590120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.591352] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.591660] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.592013] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.593665] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.593665] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.593665] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.593665] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.593665] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.593665] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.611737] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.612522] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.614968] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.614968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-145" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.614968] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-3a5107ce-9d63-46db-8bf8-a381555459e9 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.614968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.614968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.614968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.614968] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5107ce-9d63-46db-8bf8-a381555459e9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.117040] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.117040] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.117040] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.117244] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.117338] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.117493] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 3a5107ce-9d63-46db-8bf8-a381555459e9 not found, creating... [ 674.118404] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.118404] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.118404] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.118404] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.118583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.120741] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.120741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.120741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.120741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.120741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.120741] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 3a5107ce-9d63-46db-8bf8-a381555459e9 is going to be created. [ 674.141327] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.141327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.141327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.141327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.141327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.141327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.146019] env[68828]: INFO networking_nsxv3.common.synchronization [req-beacdbed-b42d-429c-ae67-3304ebe5f98d req-abb26eaa-9d2a-44c5-b989-1ebd0109f32e tempest-FloatingIPsAssociationTestJSON-1635333144 tempest-FloatingIPsAssociationTestJSON-1635333144-project-member] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 674.147143] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 674.147897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.148088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.148197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.148409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.148709] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.148817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.148880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.149096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.149153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.149224] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.524055] env[68828]: INFO networking_nsxv3.common.synchronization [req-58875d6b-eb5f-425d-9e52-3eaf0beabc21 req-439dfc52-9fb5-42b2-ab04-01b6c68c9432 tempest-FloatingIPsAssociationNegativeTestJSON-600040299 tempest-FloatingIPsAssociationNegativeTestJSON-600040299-project-member] Enqueued Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_members [ 674.525505] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGHEST for action security_group_members [ 674.525759] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.525915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.525961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.527363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.527530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.527695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.527784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.527919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.529668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.529668] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.652769] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.705374] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 674.705610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.919775] env[68828]: INFO networking_nsxv3.common.synchronization [req-b51cb6c9-9222-4bbc-9946-01dada637666 req-0af8a208-fa3c-41ff-b7c5-7f0e07ee65ba service nova] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_rules [ 674.919989] env[68828]: INFO networking_nsxv3.common.synchronization [req-b51cb6c9-9222-4bbc-9946-01dada637666 req-0af8a208-fa3c-41ff-b7c5-7f0e07ee65ba service nova] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_members [ 674.920222] env[68828]: INFO networking_nsxv3.common.synchronization [req-b51cb6c9-9222-4bbc-9946-01dada637666 req-0af8a208-fa3c-41ff-b7c5-7f0e07ee65ba service nova] Enqueued Resource ID: 3a5107ce-9d63-46db-8bf8-a381555459e9 with Priority: HIGHEST for action port [ 674.920409] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_rules [ 674.920573] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_members [ 674.920678] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a5107ce-9d63-46db-8bf8-a381555459e9 with Priority: HIGHEST for action port [ 674.923862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.923862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.923862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.923862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.923862] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.923862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.923862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.923862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.924113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.924113] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.924218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.924322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.925266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.925266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.925266] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.928602] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a5107ce-9d63-46db-8bf8-a381555459e9 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.928700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.928806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.929273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.929273] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5107ce-9d63-46db-8bf8-a381555459e9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.032337] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.032500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.032572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.032791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.036499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.036499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.036499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.036499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.036499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.036499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.036499] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6547eb98-d904-4822-951d-00fe16de337d is going to be updated. [ 675.063024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.063024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.063024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.063024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.063024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.070032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6547eb98-d904-4822-951d-00fe16de337d in Status: IN_PROGRESS for 2s [ 675.155434] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.434018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.434018] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.434018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a5107ce-9d63-46db-8bf8-a381555459e9 with status ACTIVE [ 675.434018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.434018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.434018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.434550] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.434550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.434550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.434550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.435162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.435446] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a5107ce-9d63-46db-8bf8-a381555459e9 is going to be updated. [ 675.456407] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.457804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.457804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.457804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.457804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.457804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a5107ce-9d63-46db-8bf8-a381555459e9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.657795] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.658209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.658209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.660020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.660020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.660020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be updated. [ 675.690742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.690918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.691015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.691287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.691470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.700354] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 2s [ 675.938948] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.295020] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6c11a5da-4f35-4769-a40e-9975b0fde4c7 None None] Enqueued Resource ID: ace7a372-e754-4e0f-b485-c58db9b07495 with Priority: HIGHEST for action port [ 676.295548] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace7a372-e754-4e0f-b485-c58db9b07495 with Priority: HIGHEST for action port [ 676.295859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ace7a372-e754-4e0f-b485-c58db9b07495 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.295992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ace7a372-e754-4e0f-b485-c58db9b07495" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.297759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ace7a372-e754-4e0f-b485-c58db9b07495" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.298069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ace7a372-e754-4e0f-b485-c58db9b07495" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.298161] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ace7a372-e754-4e0f-b485-c58db9b07495',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.442745] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.442979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.443100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.443363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.443842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.443996] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 is going to be created. [ 676.467253] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.467559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.467669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.467937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.468150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.477150] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 in Status: UNINITIALIZED for 2s [ 676.804236] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ace7a372-e754-4e0f-b485-c58db9b07495 [ 676.804236] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.804236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.804236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.804236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.804236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.804236] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ace7a372-e754-4e0f-b485-c58db9b07495 already deleted. [ 676.804730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ace7a372-e754-4e0f-b485-c58db9b07495" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.083946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6547eb98-d904-4822-951d-00fe16de337d in Status: SUCCESS [ 677.084133] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6547eb98-d904-4822-951d-00fe16de337d deletion is rescheduled due to dependency. [ 677.084252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.190102] env[68828]: INFO networking_nsxv3.common.synchronization [req-3c99e4ea-89fb-4ad9-a568-52138842a5bf req-1db323c6-deca-4aa8-bf79-14cac7481b73 tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 677.190102] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 677.190263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.190387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.190430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.190799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.190799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.190915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.190987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.191341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.191433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.191786] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.695575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.695789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.695857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.696093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.696187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.696568] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.696568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.696568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.696844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.696844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.696893] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 677.709658] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 4s [ 677.723380] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.723966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.724076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.724271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.724433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.732127] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 677.835649] env[68828]: INFO networking_nsxv3.common.synchronization [None req-344672d6-d88c-4f84-97b7-c526a58e23d7 tempest-MigrationsAdminTest-1798027422 tempest-MigrationsAdminTest-1798027422-project-member] Enqueued Resource ID: 9e935a5e-23fa-4715-9df0-3edd8cfea8b1 with Priority: HIGHEST for action security_group_rules [ 677.837296] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e935a5e-23fa-4715-9df0-3edd8cfea8b1 with Priority: HIGHEST for action security_group_rules [ 677.837296] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.837296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.837296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.837849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.837925] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e935a5e-23fa-4715-9df0-3edd8cfea8b1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.946998] env[68828]: INFO networking_nsxv3.common.synchronization [req-14f3a589-0a2e-4fe8-9313-1d2fcc6141b7 req-53a098bb-85b3-4b96-824e-898b789861ed tempest-AttachInterfacesV270Test-155196817 tempest-AttachInterfacesV270Test-155196817-project-member] Enqueued Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_members [ 677.947534] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_members [ 677.948178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.948178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.948615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.952299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.952498] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.952550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.952666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.953184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.953184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.953184] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.002983] env[68828]: INFO networking_nsxv3.common.synchronization [None req-31226916-0e81-4ad7-850c-9b16dbc00e24 tempest-MigrationsAdminTest-1798027422 tempest-MigrationsAdminTest-1798027422-project-member] Enqueued Resource ID: 9e935a5e-23fa-4715-9df0-3edd8cfea8b1 with Priority: HIGHEST for action security_group_rules [ 678.003482] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e935a5e-23fa-4715-9df0-3edd8cfea8b1 with Priority: HIGHEST for action security_group_rules [ 678.003771] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.003956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.358928] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.359142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.359235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.359800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.359800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.359800] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e935a5e-23fa-4715-9df0-3edd8cfea8b1 already deleted. [ 678.359800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.360749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.360918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.362032] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e935a5e-23fa-4715-9df0-3edd8cfea8b1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.363410] env[68828]: INFO networking_nsxv3.common.synchronization [None req-26218784-f056-449b-ae8f-4f2271459997 None None] Enqueued Resource ID: c9aedf76-c70e-4361-bb2a-f8a9c406c378 with Priority: HIGHEST for action port [ 678.364041] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9aedf76-c70e-4361-bb2a-f8a9c406c378 with Priority: HIGHEST for action port [ 678.364333] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9aedf76-c70e-4361-bb2a-f8a9c406c378 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.365052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9aedf76-c70e-4361-bb2a-f8a9c406c378" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.365200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9aedf76-c70e-4361-bb2a-f8a9c406c378" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.365499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9aedf76-c70e-4361-bb2a-f8a9c406c378" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.365499] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9aedf76-c70e-4361-bb2a-f8a9c406c378',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.454840] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.454992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.455086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.455327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.455380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.455910] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.455910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.455910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.455910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.455910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.456116] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff already deleted. [ 678.456116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.488804] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 in Status: SUCCESS [ 678.489070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.489269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.489548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.489780] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.489903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.489972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.490148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.490233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.490321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.490418] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.507597] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.507814] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-170" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.507943] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-170" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.508668] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-170" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.508956] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.509349] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.509349] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.509489] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.509637] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.509854] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.510165] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.510287] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.510400] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.510514] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.510649] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.510787] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.530017] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.530017] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.530017] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.530017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-170" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.530017] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-d90e56ba-0681-450a-8425-8a0912caa65e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.530017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.530017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.530017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.530017] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d90e56ba-0681-450a-8425-8a0912caa65e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.655311] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7fea6aff-a71c-4bbe-8c70-6cca0257b43b tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 678.655836] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 678.656155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.656279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.656348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.656617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.656681] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.868449] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9aedf76-c70e-4361-bb2a-f8a9c406c378 [ 678.868761] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.868821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.868987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.869128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.869224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.869322] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9aedf76-c70e-4361-bb2a-f8a9c406c378 already deleted. [ 678.869415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9aedf76-c70e-4361-bb2a-f8a9c406c378" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.886178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.886330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.886386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.887105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.889144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.889144] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e935a5e-23fa-4715-9df0-3edd8cfea8b1 already deleted. [ 678.889144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e935a5e-23fa-4715-9df0-3edd8cfea8b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.946205] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c7e76f3a-0d01-4bab-9842-a5f84f52f45e tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 678.947767] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 678.947994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.948114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.995115] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.033449] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.033771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.033905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.034310] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.034530] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.034530] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port d90e56ba-0681-450a-8425-8a0912caa65e not found, creating... [ 679.034918] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.035017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.035078] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.035316] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.035474] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.035757] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.035910] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.036483] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.036837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.036905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.037080] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: d90e56ba-0681-450a-8425-8a0912caa65e is going to be created. [ 679.055572] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.057019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.057179] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.057524] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.058091] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.058091] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.181247] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.181395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.181468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.181832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.181967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.182086] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 already deleted. [ 679.182180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.182335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.182500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.182585] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.499494] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3: rpc.has_security_group_logging(os_id): False [ 679.520358] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.520563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.520685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.521030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.521237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.521703] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.521793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.521879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.525627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.525627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.525627] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 is going to be created. [ 679.582847] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.582847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.582847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.582847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.582847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.592509] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 in Status: IN_PROGRESS for 2s [ 679.716661] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.716885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.717017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.717358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.717497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.717664] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 already deleted. [ 679.717787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.726820] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 679.727220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.742163] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 679.742163] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 679.742283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.957060] env[68828]: INFO networking_nsxv3.common.synchronization [req-14f3a589-0a2e-4fe8-9313-1d2fcc6141b7 req-56f691ca-b2bc-4c53-9b7e-eb0f34e9d920 service nova] Enqueued Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_rules [ 679.957331] env[68828]: INFO networking_nsxv3.common.synchronization [req-14f3a589-0a2e-4fe8-9313-1d2fcc6141b7 req-56f691ca-b2bc-4c53-9b7e-eb0f34e9d920 service nova] Enqueued Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_members [ 679.957488] env[68828]: INFO networking_nsxv3.common.synchronization [req-14f3a589-0a2e-4fe8-9313-1d2fcc6141b7 req-56f691ca-b2bc-4c53-9b7e-eb0f34e9d920 service nova] Enqueued Resource ID: d90e56ba-0681-450a-8425-8a0912caa65e with Priority: HIGHEST for action port [ 679.958457] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_rules [ 679.961059] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_members [ 679.961059] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d90e56ba-0681-450a-8425-8a0912caa65e with Priority: HIGHEST for action port [ 679.961059] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.961059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.961059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.961059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.961059] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.961631] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.961808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.961889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.962110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.963068] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.963068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.963068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.963068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.963068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.963068] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.963823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d90e56ba-0681-450a-8425-8a0912caa65e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.964016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.964016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.964185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.964279] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d90e56ba-0681-450a-8425-8a0912caa65e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.316646] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c9966f4f-84b0-44bb-9ac9-cd9477d296dc None None] Enqueued Resource ID: 8cd3d903-17ae-4953-b954-34ae1e3998a3 with Priority: HIGHEST for action port [ 680.317213] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cd3d903-17ae-4953-b954-34ae1e3998a3 with Priority: HIGHEST for action port [ 680.317698] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cd3d903-17ae-4953-b954-34ae1e3998a3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.317698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cd3d903-17ae-4953-b954-34ae1e3998a3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.317698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cd3d903-17ae-4953-b954-34ae1e3998a3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.319195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cd3d903-17ae-4953-b954-34ae1e3998a3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.319195] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cd3d903-17ae-4953-b954-34ae1e3998a3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.323566] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e806592-15ab-4e96-ae63-2ddaa4248f9d req-9a5b88ac-a5c9-432f-b5f2-5d77cabd4991 tempest-DeleteServersAdminTestJSON-483334800 tempest-DeleteServersAdminTestJSON-483334800-project-member] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 680.324025] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGHEST for action security_group_members [ 680.324516] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.324655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.324745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.324907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.325072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.325169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.325283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.325371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.325463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.325553] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.465837] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.466951] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.467072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.467208] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d90e56ba-0681-450a-8425-8a0912caa65e with status ACTIVE [ 680.467608] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.467608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.467608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.467771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.468181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.468181] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.468181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.468181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.468348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.468348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.468530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.468633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.468698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.468842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.468912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.469017] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d90e56ba-0681-450a-8425-8a0912caa65e is going to be updated. [ 680.491656] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.491656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.491656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.491656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.491656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.491656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d90e56ba-0681-450a-8425-8a0912caa65e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.820886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cd3d903-17ae-4953-b954-34ae1e3998a3 [ 680.821134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.821267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.821334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.821542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.821648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.821755] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cd3d903-17ae-4953-b954-34ae1e3998a3 already deleted. [ 680.821838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cd3d903-17ae-4953-b954-34ae1e3998a3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.827779] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.827779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.827779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.828150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.828150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.828268] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.830254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.830254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.830254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.830254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.830254] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be updated. [ 680.856744] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.856813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.857092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.857333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.857472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.871930] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: IN_PROGRESS for 2s [ 680.972082] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.475188] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.475364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.475438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.475713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.475811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.475914] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff is going to be created. [ 681.496519] env[68828]: INFO networking_nsxv3.common.synchronization [req-dfda09b8-b2ac-48a5-975f-4b279e71b02d req-ff22c072-a736-4906-9ee5-fffc40253d5f tempest-ServerTagsTestJSON-873036267 tempest-ServerTagsTestJSON-873036267-project-member] Enqueued Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_members [ 681.497049] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGHEST for action security_group_members [ 681.497364] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.497493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.497561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.497757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.498088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.498176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.498246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.498436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.498587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.498725] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.504609] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.504609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.504609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.504609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.504609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.511554] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff in Status: UNINITIALIZED for 2s [ 681.604121] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 in Status: SUCCESS [ 681.604403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.001174] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.001518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.002727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.002727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.003133] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e is going to be updated. [ 682.035548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.035720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.035790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.035995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.036151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.048403] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e in Status: IN_PROGRESS for 2s [ 682.297862] env[68828]: INFO networking_nsxv3.common.synchronization [None req-544d94d2-02b5-40cf-81ac-4138e40dd4f8 None None] Enqueued Resource ID: 9078eaf4-1dd9-4f96-bc76-798743c1f24c with Priority: HIGHEST for action port [ 682.298114] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9078eaf4-1dd9-4f96-bc76-798743c1f24c with Priority: HIGHEST for action port [ 682.298694] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9078eaf4-1dd9-4f96-bc76-798743c1f24c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.298817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9078eaf4-1dd9-4f96-bc76-798743c1f24c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.298887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9078eaf4-1dd9-4f96-bc76-798743c1f24c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.299155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9078eaf4-1dd9-4f96-bc76-798743c1f24c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.299231] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9078eaf4-1dd9-4f96-bc76-798743c1f24c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.804395] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9078eaf4-1dd9-4f96-bc76-798743c1f24c [ 682.805486] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.805486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.805486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.805486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.805486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.805486] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9078eaf4-1dd9-4f96-bc76-798743c1f24c already deleted. [ 682.805486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9078eaf4-1dd9-4f96-bc76-798743c1f24c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.882703] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185198c9-6b76-40ca-9634-3cee48a72a6d in Status: SUCCESS [ 682.882703] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d deletion is rescheduled due to dependency. [ 682.882852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.530022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff in Status: SUCCESS [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.530022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.530022] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.032190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.032352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.032448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.032632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.032801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.033171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.033171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.033171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.033398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.033398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.033448] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.033529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.033574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.033754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.033862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.034232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.034232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.034232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.034232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.034670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.034670] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.057186] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e in Status: SUCCESS [ 684.057357] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e deletion is rescheduled due to dependency. [ 684.057469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.538213] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff: rpc.has_security_group_logging(os_id): False [ 684.556849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.556849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.556849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.556849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.557327] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.557327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.557327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.557327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.557327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.557327] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff is going to be created. [ 684.616056] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.616056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.616056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.616056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.616056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.627725] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff in Status: IN_PROGRESS for 2s [ 685.369017] env[68828]: INFO networking_nsxv3.common.synchronization [None req-563daec7-74a0-42ab-8c1e-0dcde1b8edeb None None] Enqueued Resource ID: 8f461dd3-1629-4e21-b4ac-d7dab00e67aa with Priority: HIGHEST for action port [ 685.369017] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f461dd3-1629-4e21-b4ac-d7dab00e67aa with Priority: HIGHEST for action port [ 685.369017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f461dd3-1629-4e21-b4ac-d7dab00e67aa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.369017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f461dd3-1629-4e21-b4ac-d7dab00e67aa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.369017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f461dd3-1629-4e21-b4ac-d7dab00e67aa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.369017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f461dd3-1629-4e21-b4ac-d7dab00e67aa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.369017] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f461dd3-1629-4e21-b4ac-d7dab00e67aa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.585170] env[68828]: INFO networking_nsxv3.common.synchronization [req-eaf03d19-03c4-4609-8e6f-9f2fb50cb542 req-2ac5346b-4a1e-4679-97cf-d095f71621d3 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 685.585659] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 685.585954] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.586086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.586151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.586404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.586560] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.589019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.589019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.589019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.589019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.589019] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.871642] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f461dd3-1629-4e21-b4ac-d7dab00e67aa [ 685.872128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.872443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.872593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.873642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.873642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.873642] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f461dd3-1629-4e21-b4ac-d7dab00e67aa already deleted. [ 685.873642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f461dd3-1629-4e21-b4ac-d7dab00e67aa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.089855] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.090088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.090237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.090428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.090552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.091148] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.091148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.091148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.091335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.091518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.091518] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db already deleted. [ 686.091611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.171025] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.171146] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-157" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.171254] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-157" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.172149] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-157" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.172149] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.172149] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.172312] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.172413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.172551] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.172759] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.172869] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.172973] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.173090] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.173197] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.173300] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.173426] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.195998] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.196196] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.196340] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.196523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-157" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.196849] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-f5499431-e845-4307-8a9e-eb061ccb357c taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.197042] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.197231] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.197594] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.198405] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5499431-e845-4307-8a9e-eb061ccb357c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.637684] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff in Status: SUCCESS [ 686.637944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.705081] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.705378] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.705538] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.705862] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.706766] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.709972] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port f5499431-e845-4307-8a9e-eb061ccb357c not found, creating... [ 686.709972] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.709972] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.709972] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.709972] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.709972] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.709972] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.709972] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.710267] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.710267] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.711917] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.711917] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: f5499431-e845-4307-8a9e-eb061ccb357c is going to be created. [ 686.733121] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.733121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.733121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.733121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.733121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.733121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.551377] env[68828]: INFO networking_nsxv3.common.synchronization [req-eaf03d19-03c4-4609-8e6f-9f2fb50cb542 req-9ed6ad0a-d02b-4e41-aa69-faa6042793c3 service nova] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_rules [ 687.551564] env[68828]: INFO networking_nsxv3.common.synchronization [req-eaf03d19-03c4-4609-8e6f-9f2fb50cb542 req-9ed6ad0a-d02b-4e41-aa69-faa6042793c3 service nova] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 687.551732] env[68828]: INFO networking_nsxv3.common.synchronization [req-eaf03d19-03c4-4609-8e6f-9f2fb50cb542 req-9ed6ad0a-d02b-4e41-aa69-faa6042793c3 service nova] Enqueued Resource ID: f5499431-e845-4307-8a9e-eb061ccb357c with Priority: HIGHEST for action port [ 687.552271] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_rules [ 687.552410] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 687.552509] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5499431-e845-4307-8a9e-eb061ccb357c with Priority: HIGHEST for action port [ 687.552803] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.552928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.552994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.553289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.553371] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.554196] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.554314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.554382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.554549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.554691] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.554783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.554847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.554981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.555083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.555172] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.558529] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5499431-e845-4307-8a9e-eb061ccb357c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.558529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.558529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.558529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.558529] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5499431-e845-4307-8a9e-eb061ccb357c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.705104] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9271e714-aca0-4742-8b7d-a1738d50d485 None None] Enqueued Resource ID: e0da43d5-5e9a-4328-a354-9614ed9044ab with Priority: HIGHEST for action port [ 687.705371] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0da43d5-5e9a-4328-a354-9614ed9044ab with Priority: HIGHEST for action port [ 687.706097] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0da43d5-5e9a-4328-a354-9614ed9044ab taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.706313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0da43d5-5e9a-4328-a354-9614ed9044ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.706463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0da43d5-5e9a-4328-a354-9614ed9044ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.706858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0da43d5-5e9a-4328-a354-9614ed9044ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.707078] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0da43d5-5e9a-4328-a354-9614ed9044ab',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.058506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.058506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.058506] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.059458] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5499431-e845-4307-8a9e-eb061ccb357c with status ACTIVE [ 688.059628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.059738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.059802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.059999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.060093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.060716] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.060716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.060716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.060716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.060716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.060911] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.060911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.061062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.061490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061769] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5499431-e845-4307-8a9e-eb061ccb357c is going to be updated. [ 688.081906] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.082061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.082126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.082318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.082447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.082604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.209311] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0da43d5-5e9a-4328-a354-9614ed9044ab [ 688.209536] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.209665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.209913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.209986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.210041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.210125] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0da43d5-5e9a-4328-a354-9614ed9044ab already deleted. [ 688.210200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0da43d5-5e9a-4328-a354-9614ed9044ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.275471] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2df05f1-0cbe-4bf4-a886-75755f375de4 req-7340256f-13c4-4bee-899d-be7148bc8d5d tempest-ServersTestFqdnHostnames-595117522 tempest-ServersTestFqdnHostnames-595117522-project-member] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_members [ 688.276566] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_members [ 688.276566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.276566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.276751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.276914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.277139] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.277275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.277344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.277538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.277632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.277813] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.564110] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.677047] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.677277] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-869" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.677403] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-869" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.677746] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-869" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.678854] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.678854] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.678854] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.678854] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.678854] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.679280] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.679280] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.679280] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.679280] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.679401] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.679439] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.679569] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.698417] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.698607] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.698768] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.698948] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-869" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.699267] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.699437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.699569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.699997] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.700153] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99cc7a76-3e49-491c-b8d6-3a4565e9e15e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.779464] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.779718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.779718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.779899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.779986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.780228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.780285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.780339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.780489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.780559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.780641] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 already deleted. [ 688.780754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.066688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.066859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.066934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.067164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.067258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.067357] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be created. [ 689.089867] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.090026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.090100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.090319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.090484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.098614] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: UNINITIALIZED for 2s [ 689.202289] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.202510] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.202642] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.202932] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.203257] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.203434] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 99cc7a76-3e49-491c-b8d6-3a4565e9e15e not found, creating... [ 689.203708] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.203871] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.203991] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.204239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.204382] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.204672] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.204831] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.204947] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.205180] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.205326] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.205467] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 99cc7a76-3e49-491c-b8d6-3a4565e9e15e is going to be created. [ 689.223431] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.223618] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.223749] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.223993] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.224225] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.224443] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.005472] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2df05f1-0cbe-4bf4-a886-75755f375de4 req-cf2e67a0-c824-49d9-ad1d-54363151a43d service nova] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_rules [ 690.005743] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2df05f1-0cbe-4bf4-a886-75755f375de4 req-cf2e67a0-c824-49d9-ad1d-54363151a43d service nova] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_members [ 690.005743] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2df05f1-0cbe-4bf4-a886-75755f375de4 req-cf2e67a0-c824-49d9-ad1d-54363151a43d service nova] Enqueued Resource ID: 99cc7a76-3e49-491c-b8d6-3a4565e9e15e with Priority: HIGHEST for action port [ 690.005919] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_rules [ 690.006063] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_members [ 690.006160] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99cc7a76-3e49-491c-b8d6-3a4565e9e15e with Priority: HIGHEST for action port [ 690.006686] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.006870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.006870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.007097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.007178] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.010737] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.010737] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.010737] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.010737] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.010737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.010737] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99cc7a76-3e49-491c-b8d6-3a4565e9e15e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.512823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.513047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.513240] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.514241] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99cc7a76-3e49-491c-b8d6-3a4565e9e15e with status ACTIVE [ 690.515254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.515254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.515254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.515254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.515254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.515254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.515254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.515644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.515644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.515644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.516221] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.516221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.516221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.516221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.516221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.516448] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99cc7a76-3e49-491c-b8d6-3a4565e9e15e is going to be updated. [ 690.538984] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.539164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.539385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.539492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.539681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.540340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99cc7a76-3e49-491c-b8d6-3a4565e9e15e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.019333] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.109501] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 691.109739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.110066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.110147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.110343] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.110464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.110529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.110718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.110792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.110882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.110972] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.526023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.526023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.526023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.526023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.528027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.528027] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 is going to be created. [ 691.554348] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.554570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.554570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.554776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.554934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.563201] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 in Status: UNINITIALIZED for 2s [ 691.615361] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.615361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.615361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.615731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.616045] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.616730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.616730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.616730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.616860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.617039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.617469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.617636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.617742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.617971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.618572] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.618572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.618572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.619507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.619507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.619507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.619633] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.122305] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cfee739-816c-4ab2-8883-cdd3c2d159db: rpc.has_security_group_logging(os_id): False [ 692.142788] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.142975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.143116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.143327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.143427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.143635] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.143746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.143814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.143992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.144249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.144341] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.144416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.144501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.144661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.144742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.144970] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.145095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.145170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.145326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.145418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.145517] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be created. [ 692.224182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.224297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.224372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.224589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.224798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.236130] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 693.575291] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 in Status: SUCCESS [ 693.575611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.575675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.575845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.576041] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.576162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.576233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.576369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.576446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.576535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.576615] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.644831] env[68828]: INFO networking_nsxv3.common.synchronization [req-479618fc-5f73-4fc1-a5ba-6c6cfdcb248c req-fb08e341-4c70-436d-a326-87267013b512 tempest-InstanceActionsTestJSON-938901203 tempest-InstanceActionsTestJSON-938901203-project-member] Enqueued Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_members [ 693.645473] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_members [ 693.645917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.646803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.646967] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.647088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.647149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.647310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.647399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.647491] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.079028] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.137113] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.137113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.137113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.137113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.137363] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.137449] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.137521] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.137734] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.137963] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.138241] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.138379] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.138509] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.138667] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.138841] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.138975] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.139149] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.150642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.150642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.150642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.150642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.150642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.150642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.151035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.151035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.151035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.151143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.151172] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29278155-2b69-484f-b19d-598dcb421e94 already deleted. [ 694.151257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.161394] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.162031] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.162031] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.162031] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.162828] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-df04a7fa-7202-4588-9d95-4b90fcf6cfca taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.162828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.162828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.164614] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.164614] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df04a7fa-7202-4588-9d95-4b90fcf6cfca',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.248665] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 694.248947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.353218] env[68828]: INFO networking_nsxv3.common.synchronization [req-4573c759-33ff-4f93-ba9f-cdc457e5abe1 req-fb644f82-a30e-4089-b734-72a870334bae tempest-AttachInterfacesV270Test-155196817 tempest-AttachInterfacesV270Test-155196817-project-member] Enqueued Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_members [ 694.353828] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGHEST for action security_group_members [ 694.354163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.354321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.354390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.354671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.354749] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.354852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.354936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.355072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.355181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.355278] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.582898] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c70394b-e7ce-40e9-946e-b190f72998f8: rpc.has_security_group_logging(os_id): False [ 694.603457] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.603640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.603753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.603966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.604104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.604434] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.604574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.604677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.604835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.604944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.605054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 is going to be created. [ 694.662216] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.662364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.662414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.662642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.662797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.667218] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.667420] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.667534] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.668266] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.668266] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.668266] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port df04a7fa-7202-4588-9d95-4b90fcf6cfca not found, creating... [ 694.668462] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.668618] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.668672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.669672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.669672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.669672] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.669672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.669672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.669932] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.670046] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.670189] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: df04a7fa-7202-4588-9d95-4b90fcf6cfca is going to be created. [ 694.672854] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 in Status: IN_PROGRESS for 2s [ 694.688607] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.688879] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.689137] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.689477] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.689740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.690052] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.861215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.861215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.861404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.861537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.861654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.861884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.861992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.862130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.862240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.862323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.862424] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff is going to be updated. [ 694.896637] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.896818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.896914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.898042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.898042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.909201] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff in Status: IN_PROGRESS for 2s [ 695.516118] env[68828]: INFO networking_nsxv3.common.synchronization [req-479618fc-5f73-4fc1-a5ba-6c6cfdcb248c req-6138c0f7-5aa2-42e4-be54-e17e6a557a02 service nova] Enqueued Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_rules [ 695.516299] env[68828]: INFO networking_nsxv3.common.synchronization [req-479618fc-5f73-4fc1-a5ba-6c6cfdcb248c req-6138c0f7-5aa2-42e4-be54-e17e6a557a02 service nova] Enqueued Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_members [ 695.516443] env[68828]: INFO networking_nsxv3.common.synchronization [req-479618fc-5f73-4fc1-a5ba-6c6cfdcb248c req-6138c0f7-5aa2-42e4-be54-e17e6a557a02 service nova] Enqueued Resource ID: df04a7fa-7202-4588-9d95-4b90fcf6cfca with Priority: HIGHEST for action port [ 695.516673] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_rules [ 695.516837] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_members [ 695.516934] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df04a7fa-7202-4588-9d95-4b90fcf6cfca with Priority: HIGHEST for action port [ 695.517511] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.519016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.519016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.519016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.519016] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.519506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.519630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.519695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.519881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.520031] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.520131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.520185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.520318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.520398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.520487] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.523009] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-df04a7fa-7202-4588-9d95-4b90fcf6cfca taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.523009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.523009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.523009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.523009] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df04a7fa-7202-4588-9d95-4b90fcf6cfca',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.024033] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.024693] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.024806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.025179] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df04a7fa-7202-4588-9d95-4b90fcf6cfca with status ACTIVE [ 696.025343] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.025473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.025559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.025769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.025860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.026169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.026169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.026169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.026319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.026420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.026955] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.026955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.026955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.026955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.026955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.026955] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df04a7fa-7202-4588-9d95-4b90fcf6cfca is going to be updated. [ 696.053146] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.053295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.053367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.053569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.053732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.053921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df04a7fa-7202-4588-9d95-4b90fcf6cfca" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.410278] env[68828]: INFO networking_nsxv3.common.synchronization [req-80762f1a-9fcb-4920-a6f9-a75c92e30511 req-01b88a65-0de5-492a-957a-ff143aac39d5 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 696.410795] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 696.413764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.413919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.413987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.414252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.414416] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.414516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.414579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.414731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.414817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.414908] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.526260] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.723762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 in Status: SUCCESS [ 696.723989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.915445] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.915677] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.915806] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.916259] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.916548] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.916706] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.916823] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.917063] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.917229] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.917436] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.917558] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.917669] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.917792] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.917903] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.918025] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.918169] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.920053] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff in Status: SUCCESS [ 696.920230] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff deletion is rescheduled due to dependency. [ 696.920344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.920931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.921056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.921154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.921288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.921361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.921533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.921624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.921679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.921904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.921959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.922035] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 already deleted. [ 696.922106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.940204] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.940399] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.940547] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.940833] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.941231] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5e284546-5e40-42b8-8aac-bf4cb377e1db taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.941413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.941546] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.941991] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.942172] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e284546-5e40-42b8-8aac-bf4cb377e1db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.030348] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.030740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.030740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.030813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.030929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.031044] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29278155-2b69-484f-b19d-598dcb421e94 is going to be created. [ 697.081766] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.081766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.081766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.081999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.082244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.092163] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29278155-2b69-484f-b19d-598dcb421e94 in Status: UNINITIALIZED for 2s [ 697.448352] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.448592] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.448692] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.449041] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.449209] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.449382] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5e284546-5e40-42b8-8aac-bf4cb377e1db not found, creating... [ 697.449643] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.449797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.449912] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.450146] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.450283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.450563] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.451306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.451306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.451306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.451306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.451571] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5e284546-5e40-42b8-8aac-bf4cb377e1db is going to be created. [ 697.471647] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.471864] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.471989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.472301] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.472564] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.472824] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.306801] env[68828]: INFO networking_nsxv3.common.synchronization [req-80762f1a-9fcb-4920-a6f9-a75c92e30511 req-475e2424-f9f2-4165-a0bf-32ca2bfc7537 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 698.306801] env[68828]: INFO networking_nsxv3.common.synchronization [req-80762f1a-9fcb-4920-a6f9-a75c92e30511 req-475e2424-f9f2-4165-a0bf-32ca2bfc7537 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 698.306801] env[68828]: INFO networking_nsxv3.common.synchronization [req-80762f1a-9fcb-4920-a6f9-a75c92e30511 req-475e2424-f9f2-4165-a0bf-32ca2bfc7537 service nova] Enqueued Resource ID: 5e284546-5e40-42b8-8aac-bf4cb377e1db with Priority: HIGHEST for action port [ 698.306801] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 698.306801] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 698.306801] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e284546-5e40-42b8-8aac-bf4cb377e1db with Priority: HIGHEST for action port [ 698.307381] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.307743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.307743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.307841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.307875] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.310446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.310577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.310633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.310830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.311014] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.311115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.311177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.311326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.311410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.311498] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.312493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e284546-5e40-42b8-8aac-bf4cb377e1db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.312493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.312493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.312668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.312734] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e284546-5e40-42b8-8aac-bf4cb377e1db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.814185] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.814338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.815735] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e284546-5e40-42b8-8aac-bf4cb377e1db with status ACTIVE [ 698.815905] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.816029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.816094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.816302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.816410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.816556] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.816700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.816700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.816872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.816924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.817105] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.817195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.817249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.817382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.817455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.817538] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e284546-5e40-42b8-8aac-bf4cb377e1db is going to be updated. [ 698.818596] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.840111] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.840242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.840353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.840487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.840616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.840778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e284546-5e40-42b8-8aac-bf4cb377e1db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.101924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29278155-2b69-484f-b19d-598dcb421e94 in Status: SUCCESS [ 699.102712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.102712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.102712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.102881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.102971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.102971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.103468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.103468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.103468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.103622] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.323624] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.605838] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.605992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.606076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.606293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.606459] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.606562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.606624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.606769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.606856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.606940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.607094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.607185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.607265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.607395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.607605] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.607605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.607710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.607815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.607893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.607971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.608074] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.826077] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.826994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.826994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.826994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.826994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.826994] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be created. [ 699.848763] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.848943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.849025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.849243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.849398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.858215] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: UNINITIALIZED for 2s [ 700.110462] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29278155-2b69-484f-b19d-598dcb421e94: rpc.has_security_group_logging(os_id): False [ 700.131494] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.131694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.131764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.132483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.132483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.132483] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.132483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.132907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.133172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.133805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.133805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.133805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.133805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.133805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.134129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.134129] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.134231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.134276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.134393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.134469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.134552] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29278155-2b69-484f-b19d-598dcb421e94 is going to be created. [ 700.192865] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.193053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.193150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.193339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.193546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.211802] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29278155-2b69-484f-b19d-598dcb421e94 in Status: IN_PROGRESS for 2s [ 700.218341] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-00cb25fc-28c9-4b40-bfe2-df0716fa9817 tempest-ListServersNegativeTestJSON-1806494464 tempest-ListServersNegativeTestJSON-1806494464-project-member] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 700.219720] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 700.219720] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.219861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.219956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.220259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.220417] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.220531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.220602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.220735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.220840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.222048] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.728488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.728853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.728853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.729109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.729269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.729554] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.729731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.729841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.730114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.730218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.730312] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 already deleted. [ 700.730431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.780956] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.781181] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.781314] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.781624] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.781899] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.782077] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.782194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.782411] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.782556] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.782755] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.782891] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.782972] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.786188] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.786338] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.786452] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.786777] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.817038] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.817213] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.817399] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.818570] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.818570] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c2d568a7-1d2d-4096-81fe-246a0c912669 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.818570] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.818570] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.818570] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.818774] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2d568a7-1d2d-4096-81fe-246a0c912669',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.321729] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.321974] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.322121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.322399] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.322550] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.322735] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c2d568a7-1d2d-4096-81fe-246a0c912669 not found, creating... [ 701.322998] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.323212] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.323349] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.323592] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.323735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.324053] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.324221] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.324339] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.324547] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.324679] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.324822] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c2d568a7-1d2d-4096-81fe-246a0c912669 is going to be created. [ 701.347928] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.348111] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.348237] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.348521] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.348735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.349013] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.871533] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.871533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.871533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.872377] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.107127] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-90bb16ed-d19e-41c8-afc3-af0662ad4429 service nova] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_rules [ 702.107206] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-90bb16ed-d19e-41c8-afc3-af0662ad4429 service nova] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 702.107341] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-90bb16ed-d19e-41c8-afc3-af0662ad4429 service nova] Enqueued Resource ID: c2d568a7-1d2d-4096-81fe-246a0c912669 with Priority: HIGHEST for action port [ 702.107563] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_rules [ 702.107749] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 702.107867] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d568a7-1d2d-4096-81fe-246a0c912669 with Priority: HIGHEST for action port [ 702.108422] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.108593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.108660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.108854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.108927] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.109764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.110345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.110345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.110345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.110345] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.110345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.110861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.110861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.110861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.110861] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.111586] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2d568a7-1d2d-4096-81fe-246a0c912669 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.111702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.111760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.111954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.112059] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2d568a7-1d2d-4096-81fe-246a0c912669',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.226679] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29278155-2b69-484f-b19d-598dcb421e94 in Status: SUCCESS [ 702.226679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.377085] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.377352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.377433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.377703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.377935] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.378542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.378542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.378647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.378910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.379077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.379275] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.379387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.379472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.379665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.379835] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.379992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.380853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.380853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.380853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.380853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.380853] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.613934] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.616844] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.616844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.616844] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2d568a7-1d2d-4096-81fe-246a0c912669 with status ACTIVE [ 702.616844] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.617277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.617277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.617277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.617277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.617423] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.617935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.617935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.617935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.617935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.618121] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.618121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.618196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.618291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.618377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.618462] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2d568a7-1d2d-4096-81fe-246a0c912669 is going to be updated. [ 702.639820] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.639820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.640014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.640083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.640218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.640363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2d568a7-1d2d-4096-81fe-246a0c912669" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.883063] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fdb4832-fb6b-46dc-9929-5e545ccfc219: rpc.has_security_group_logging(os_id): False [ 702.902045] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.902235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.902361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.902460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.902552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.902766] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.902856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.902920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.903078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.904028] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.904028] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.904028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.907633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.907633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.907633] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be created. [ 702.964327] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.964327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.964327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.964587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.966067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.974465] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 703.116497] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.619330] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.619330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.619330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.619330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.619330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.619330] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be created. [ 703.643855] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.643855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.643855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.643855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.643855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.652114] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: UNINITIALIZED for 2s [ 704.985570] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 704.985861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.663068] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 705.663292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.663458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.663674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.663989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.664145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.664211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.664369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.664475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.664565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.664656] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.849729] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 705.849729] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_members [ 705.850482] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 705.850738] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_members [ 705.851432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.851432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.851432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.851680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.851921] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.852085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.852200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.852416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.852550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.852696] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.854131] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d43f247-d27b-4e07-859a-6cbd693ade82 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.854425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.854530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.854823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.855109] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.855346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.855346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.855446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.855544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.855664] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.988165] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_rules [ 705.988165] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_members [ 705.988165] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_rules [ 705.988165] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 705.988165] env[68828]: INFO networking_nsxv3.common.synchronization [req-c84d425d-723b-4617-8841-4b03ee26d23d req-8eb223f0-8878-4e53-8da7-c575cbb770e0 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: f5499431-e845-4307-8a9e-eb061ccb357c with Priority: HIGHEST for action port [ 705.988922] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_rules [ 705.989366] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_rules [ 705.989593] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5499431-e845-4307-8a9e-eb061ccb357c with Priority: HIGHEST for action port [ 705.989781] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_members [ 705.990064] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 705.990554] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d43f247-d27b-4e07-859a-6cbd693ade82 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.990810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.991062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.991407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.991577] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.992729] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.992946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.994017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.994017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.994017] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.994345] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5499431-e845-4307-8a9e-eb061ccb357c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.994560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.994715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.994952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.995187] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5499431-e845-4307-8a9e-eb061ccb357c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.998840] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d43f247-d27b-4e07-859a-6cbd693ade82 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.999084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.999399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.999596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.142570] env[68828]: INFO networking_nsxv3.common.synchronization [req-534fac2e-4a35-4696-a0c0-d8525146de8a req-d69f8164-5112-40ef-9649-ab9e8d89e8e3 tempest-FloatingIPsAssociationTestJSON-1635333144 tempest-FloatingIPsAssociationTestJSON-1635333144-project-member] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 706.143169] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGHEST for action security_group_members [ 706.143484] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.143609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.143675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.143871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.144889] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.145058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.145131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.145324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.145416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.145610] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.168715] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.169106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.169106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.169750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.169750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.169750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.169750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.169750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.169750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.169958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.169986] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.170064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.170122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.170757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.170757] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.170757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.170757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.170757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.170757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.171042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.171042] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.358459] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.359863] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.498713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5499431-e845-4307-8a9e-eb061ccb357c with status ACTIVE [ 706.499207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.499878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.502164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.503072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.503072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.503072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.503072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.503072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.503072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.503072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.503362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.503362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.503362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.503482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.503563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.503651] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5499431-e845-4307-8a9e-eb061ccb357c is going to be updated. [ 706.504882] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d43f247-d27b-4e07-859a-6cbd693ade82 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.504981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.505222] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.505306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.526112] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.526112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.526112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.526112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.526295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.526327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.613718] env[68828]: INFO networking_nsxv3.common.synchronization [req-d1a696e6-c812-4edc-b3b6-5a7236a0022a req-49a46b66-bff7-42f3-9bf1-6a5edd497ec2 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 706.613954] env[68828]: INFO networking_nsxv3.common.synchronization [req-d1a696e6-c812-4edc-b3b6-5a7236a0022a req-49a46b66-bff7-42f3-9bf1-6a5edd497ec2 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_members [ 706.614490] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 706.614700] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 with Priority: HIGHEST for action security_group_members [ 706.615026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.615160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.615345] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d43f247-d27b-4e07-859a-6cbd693ade82 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.615437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.647903] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.648060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.648194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.648335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.648410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.648577] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.648684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.648744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.648863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.648939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.649025] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be updated. [ 706.674069] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f9b2db3-6e42-4115-b9f5-1eac57c03110: rpc.has_security_group_logging(os_id): False [ 706.691301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.691464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.691522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.691869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.691869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.696431] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.696566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.696624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.696837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.696926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.697167] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.697307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.697387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.697495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.697623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.697758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.697877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.697963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.698119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.698265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.698441] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.698536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.698600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.698752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.699605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.699605] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be created. [ 706.702775] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 2s [ 706.783701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.783853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.783933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.784155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.784337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.797109] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 706.863657] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.864720] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.921865] env[68828]: INFO networking_nsxv3.common.synchronization [req-d1a696e6-c812-4edc-b3b6-5a7236a0022a req-49a46b66-bff7-42f3-9bf1-6a5edd497ec2 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_rules [ 706.922085] env[68828]: INFO networking_nsxv3.common.synchronization [req-d1a696e6-c812-4edc-b3b6-5a7236a0022a req-49a46b66-bff7-42f3-9bf1-6a5edd497ec2 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 706.922236] env[68828]: INFO networking_nsxv3.common.synchronization [req-d1a696e6-c812-4edc-b3b6-5a7236a0022a req-49a46b66-bff7-42f3-9bf1-6a5edd497ec2 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: f5499431-e845-4307-8a9e-eb061ccb357c with Priority: HIGHEST for action port [ 706.922704] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_rules [ 706.922833] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 706.922946] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5499431-e845-4307-8a9e-eb061ccb357c with Priority: HIGHEST for action port [ 706.923372] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.923569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.923723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.923815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.923994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5499431-e845-4307-8a9e-eb061ccb357c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.924106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.924180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.924359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.924441] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5499431-e845-4307-8a9e-eb061ccb357c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.364446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.364793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.364793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.364896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.365298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.365298] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be updated. [ 707.367516] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.367516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.367662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.368434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.368434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.368434] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 is going to be created. [ 707.386545] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.386664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.386720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.386924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.387161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.389317] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.389441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.389441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.391154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.391154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.398209] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 707.398727] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 in Status: UNINITIALIZED for 2s [ 707.426280] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5499431-e845-4307-8a9e-eb061ccb357c with status ACTIVE [ 707.426538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.426678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.426747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.426953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.427085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.427234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.427542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.427602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.428635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.428635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.428635] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.428635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.428635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.428635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.428635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.428635] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5499431-e845-4307-8a9e-eb061ccb357c is going to be updated. [ 707.448197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.448323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.448430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.448671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.449404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.449404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5499431-e845-4307-8a9e-eb061ccb357c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.896832] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-57cdb1d6-4dc8-4db3-bac4-99466a03b851 tempest-ListServersNegativeTestJSON-1806494464 tempest-ListServersNegativeTestJSON-1806494464-project-member] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 707.897369] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 707.897655] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.897774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.897854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.899864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.900556] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.900677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.900744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.900947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.901043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.901137] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.139961] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9ff310db-1d59-4a65-b00e-dbbe772e66cc None None] Enqueued Resource ID: c777ff16-f255-497d-ab52-aa69bc0133ea with Priority: HIGHEST for action port [ 708.140259] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c777ff16-f255-497d-ab52-aa69bc0133ea with Priority: HIGHEST for action port [ 708.140804] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c777ff16-f255-497d-ab52-aa69bc0133ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.140954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c777ff16-f255-497d-ab52-aa69bc0133ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.141025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c777ff16-f255-497d-ab52-aa69bc0133ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.141287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c777ff16-f255-497d-ab52-aa69bc0133ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.141370] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c777ff16-f255-497d-ab52-aa69bc0133ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.403016] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.453264] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.453480] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.453618] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.453901] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.454638] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.454638] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.454638] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.454886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.455427] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.455427] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.455427] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.455427] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.455657] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.456484] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.456484] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.456484] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.473454] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.473629] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 708.473931] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.473931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.474276] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.474419] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.474543] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.475026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.475122] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a629f226-ce16-4a9b-b8e4-86ac4877c5b4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.647517] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c777ff16-f255-497d-ab52-aa69bc0133ea [ 708.648593] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.648593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.648593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.648593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.648593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.648593] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c777ff16-f255-497d-ab52-aa69bc0133ea already deleted. [ 708.648593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c777ff16-f255-497d-ab52-aa69bc0133ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.711692] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: IN_PROGRESS for 4s [ 708.809123] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 708.809374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.907565] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.979019] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.979019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.979019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.979019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.979019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.979019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port a629f226-ce16-4a9b-b8e4-86ac4877c5b4 not found, creating... [ 708.979019] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.979495] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.979495] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.979659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.979852] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.980201] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.980412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.980538] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.980796] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.980958] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.981126] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: a629f226-ce16-4a9b-b8e4-86ac4877c5b4 is going to be created. [ 709.001597] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.001804] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.001946] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.002268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.003583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.003583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.410173] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.412655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.412859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.413182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.413395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.413587] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 709.418763] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 709.418763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.418763] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 in Status: SUCCESS [ 709.418763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.418763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.418763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.422242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.422357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.422435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.422669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.422797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.422937] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.423969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.424203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.424518] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.424598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.424666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.424860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.424973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.425114] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.455675] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.455884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.455961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.456206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.456369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.464528] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 709.490935] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d97d48f5-9288-4598-a5e2-b468cb639161 tempest-ServersTestBootFromVolume-617483818 tempest-ServersTestBootFromVolume-617483818-project-member] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_rules [ 709.491104] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_rules [ 709.491889] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.491889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.491889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.492175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.492175] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.637883] env[68828]: INFO networking_nsxv3.common.synchronization [None req-93329a24-bef9-4029-b828-f92ee1b99e24 tempest-ServersTestBootFromVolume-617483818 tempest-ServersTestBootFromVolume-617483818-project-member] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_rules [ 709.639424] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_rules [ 709.639424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.639424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.928157] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.929395] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.929538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.929633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.929869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.929975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.930189] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.930288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.930364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.930523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.930626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.930713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 is going to be deleted. [ 709.996153] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.996299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.996395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.996590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.996680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.996779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.997868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.998069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.998245] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.998351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.998416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.998560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.998870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.998974] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.003192] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-6750037a-2c8a-4cb3-8a23-8ed8566b819f service nova] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_rules [ 710.003406] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-6750037a-2c8a-4cb3-8a23-8ed8566b819f service nova] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 710.003546] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-6750037a-2c8a-4cb3-8a23-8ed8566b819f service nova] Enqueued Resource ID: a629f226-ce16-4a9b-b8e4-86ac4877c5b4 with Priority: HIGHEST for action port [ 710.003765] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_rules [ 710.003921] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 710.004038] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a629f226-ce16-4a9b-b8e4-86ac4877c5b4 with Priority: HIGHEST for action port [ 710.004548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.004665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.004733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.006208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.006889] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.010530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.010530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.010530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.010530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.010530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.010530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.010530] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a629f226-ce16-4a9b-b8e4-86ac4877c5b4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.017144] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.017144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.017639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.017938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.018094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.018328] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 already deleted. [ 710.018584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.019429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.020146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.020332] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.303998] env[68828]: INFO networking_nsxv3.common.synchronization [None req-13155ee4-0499-47d0-9e7a-0565bc635cc8 None None] Enqueued Resource ID: 6b7bae9f-44f7-4c14-ae2f-3e433c41f667 with Priority: HIGHEST for action port [ 710.304811] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7bae9f-44f7-4c14-ae2f-3e433c41f667 with Priority: HIGHEST for action port [ 710.304811] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b7bae9f-44f7-4c14-ae2f-3e433c41f667 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.305098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b7bae9f-44f7-4c14-ae2f-3e433c41f667" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.305098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b7bae9f-44f7-4c14-ae2f-3e433c41f667" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.305289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b7bae9f-44f7-4c14-ae2f-3e433c41f667" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.306480] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b7bae9f-44f7-4c14-ae2f-3e433c41f667',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.432703] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.504192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.504192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.504192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.504192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.504192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.504192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.504192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.504457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.504457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.504510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.504553] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 already deleted. [ 710.504628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.504728] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.505720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.505883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.507104] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.507266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.507359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.507482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.507560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.507649] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.510543] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.511698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.515140] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a629f226-ce16-4a9b-b8e4-86ac4877c5b4 with status ACTIVE [ 710.515344] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.515461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.515546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.515727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.515815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.516048] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.516111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.516166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.516291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.516369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.516543] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.516634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.516695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.516832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.516911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.516996] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a629f226-ce16-4a9b-b8e4-86ac4877c5b4 is going to be updated. [ 710.545243] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.545243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.545243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.545243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.545243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.545243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a629f226-ce16-4a9b-b8e4-86ac4877c5b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.551132] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.551132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.551132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.551132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.551132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.551132] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 already deleted. [ 710.551132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.724197] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71fe85b-2b15-476f-8dc2-6739692bced0 in Status: SUCCESS [ 710.724379] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 deletion is rescheduled due to dependency. [ 710.724491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.811168] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b7bae9f-44f7-4c14-ae2f-3e433c41f667 [ 710.811409] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.811539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.811612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.811820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.811928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.812035] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b7bae9f-44f7-4c14-ae2f-3e433c41f667 already deleted. [ 710.812124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b7bae9f-44f7-4c14-ae2f-3e433c41f667" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.938579] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.938780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.938867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.939093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.939193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.939293] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be updated. [ 710.963939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.964123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.964183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.964392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.964537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.972344] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 711.010990] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.011194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.011263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.014020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.014020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 already deleted. [ 711.014020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.014020] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d43f247-d27b-4e07-859a-6cbd693ade82',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.474154] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 711.474479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.474582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.475117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.475385] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.475552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.475633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.477159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.477273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.477412] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.515129] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d43f247-d27b-4e07-859a-6cbd693ade82: rpc.has_security_group_logging(os_id): False [ 711.532273] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.532411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.532448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.532661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.532781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.533019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.533217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.533217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.533400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.533482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.533571] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 is going to be created. [ 711.549375] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0d43f247-d27b-4e07-859a-6cbd693ade82], does not exist path=[/infra/domains/default/groups/0d43f247-d27b-4e07-859a-6cbd693ade82]."\n}' [ 711.549562] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0d43f247-d27b-4e07-859a-6cbd693ade82 [ 711.549687] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 711.575878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.576063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.576063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.576204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.577169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.577433] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.577545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.577608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.577771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.577845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.578043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.578134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.578201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.578328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.578404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.578487] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d43f247-d27b-4e07-859a-6cbd693ade82 is going to be created. [ 711.594541] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0d43f247-d27b-4e07-859a-6cbd693ade82], does not exist path=[/infra/domains/default/groups/0d43f247-d27b-4e07-859a-6cbd693ade82]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0d43f247-d27b-4e07-859a-6cbd693ade82 [ 711.594700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d43f247-d27b-4e07-859a-6cbd693ade82" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.595226] env[68828]: Traceback (most recent call last): [ 711.595263] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 711.595263] env[68828]: return func(*args, **kwargs) [ 711.595263] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 711.595263] env[68828]: res.raise_for_status() [ 711.595263] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 711.595263] env[68828]: raise HTTPError(http_error_msg, response=self) [ 711.595263] env[68828]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0d43f247-d27b-4e07-859a-6cbd693ade82 [ 711.595474] env[68828]: During handling of the above exception, another exception occurred: [ 711.595474] env[68828]: Traceback (most recent call last): [ 711.595474] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 711.595474] env[68828]: listener.cb(fileno) [ 711.595474] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 711.595474] env[68828]: result = function(*args, **kwargs) [ 711.595474] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 711.595474] env[68828]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 711.595474] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 711.595474] env[68828]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 711.595474] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 711.595474] env[68828]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 711.595474] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 711.595474] env[68828]: res.raise_for_status() [ 711.595474] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 711.595474] env[68828]: raise HTTPError(http_error_msg, response=self) [ 711.595474] env[68828]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0d43f247-d27b-4e07-859a-6cbd693ade82 [ 711.595474] env[68828]: Removing descriptor: 17 [ 711.980309] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.485348] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.981231] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 712.981465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.981612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.981842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.982037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.982157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.982220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.982363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.982445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.982531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.982626] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.983464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.983641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.983780] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.983916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.983958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.984089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.984230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.984272] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.988440] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.988547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.988621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.988800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.988876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.988957] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 713.012035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.012234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.012293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.012478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.012640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.021714] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 713.485692] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.485999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.486245] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.991015] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.491538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.491849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.491849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.491991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.492103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.492204] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be updated. [ 714.517430] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.517609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.517807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.517898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.518076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.528034] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 715.033258] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 715.033486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.033658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.033871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.034080] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.034200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.034267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.034423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.034506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.034593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.034736] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.198214] env[68828]: INFO networking_nsxv3.common.synchronization [req-9b049a0d-b98a-42f0-892a-0fa2f7d971c9 req-0bd510ce-dadd-4d7a-998a-e097f38ce6f4 tempest-InstanceActionsTestJSON-938901203 tempest-InstanceActionsTestJSON-938901203-project-member] Enqueued Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_members [ 715.198711] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGHEST for action security_group_members [ 715.199095] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.199220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.199286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.199477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.199628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.199786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.199786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.199919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.203160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.203271] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.539073] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539073] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.539073] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.539862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.539862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.539862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.539862] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.709259] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.709259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.709259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.709259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.727980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.728382] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.728544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.728618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.728894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.728990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.729177] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29278155-2b69-484f-b19d-598dcb421e94 is going to be updated. [ 715.753118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.753211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.753308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.753722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.753722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.764660] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29278155-2b69-484f-b19d-598dcb421e94 in Status: IN_PROGRESS for 2s [ 716.042642] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f9b2db3-6e42-4115-b9f5-1eac57c03110: rpc.has_security_group_logging(os_id): False [ 716.058987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.059685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.059685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.059685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.076274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.076588] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.076725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.076774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.077297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.077297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.077297] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.077463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.077463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.077527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.077583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.077749] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.077833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.077890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.078105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.078105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.078202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 716.134277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.134430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.134472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.134674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.134819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.146814] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 716.211083] env[68828]: INFO networking_nsxv3.common.synchronization [req-b5c92a2c-1b02-405d-b98a-ad79c17fef2d req-4b123f25-847c-4f76-b7ab-01ecb3e54296 tempest-ServerRescueTestJSONUnderV235-1281115012 tempest-ServerRescueTestJSONUnderV235-1281115012-project-member] Enqueued Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 716.212565] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db with Priority: HIGHEST for action security_group_members [ 716.212565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.212565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.538165] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 716.538407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.538567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.538830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.539026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.539158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.539507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.539507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.539507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.539507] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.045701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.049025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.049025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.049025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.067258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.067620] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.067807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.067903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.068157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.068240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.068347] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be updated. [ 717.095838] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.095838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.095838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.095838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.096067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.103756] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 717.146222] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-d90e04c2-d1ef-49b0-9871-468650c2b350 tempest-ListServersNegativeTestJSON-1806494464 tempest-ListServersNegativeTestJSON-1806494464-project-member] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 717.146515] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 717.146808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.147466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.147466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.147466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.147466] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.147691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.147691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.147691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.149472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.149472] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.526813] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.527026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.527157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.527567] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.528066] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.528066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.528210] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.528323] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.528464] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.528673] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.528836] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.529142] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.529142] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.529249] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.529312] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.529436] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.548283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.548581] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.548581] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.548757] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-634" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.549138] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-36a2d676-4da5-411e-bab0-dd33975d5e2d taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.549381] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.549441] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.549758] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.549894] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a2d676-4da5-411e-bab0-dd33975d5e2d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.650590] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.779024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29278155-2b69-484f-b19d-598dcb421e94 in Status: SUCCESS [ 717.779024] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29278155-2b69-484f-b19d-598dcb421e94 deletion is rescheduled due to dependency. [ 717.779024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.053524] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.053750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.054073] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.054215] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.054375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.054535] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 36a2d676-4da5-411e-bab0-dd33975d5e2d not found, creating... [ 718.054821] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.054996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.055132] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.055354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.055522] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.055898] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.056088] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.056211] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.056658] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.056658] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.056783] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 36a2d676-4da5-411e-bab0-dd33975d5e2d is going to be created. [ 718.079794] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.079794] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.080029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.081070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.081070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.081070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.152901] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.166142] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 718.166399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.655463] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.655703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.655703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.656020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.656182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.656296] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 718.684692] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.684832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.684906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.685141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.685284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.696116] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 718.789531] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-ad4b570d-9bee-45d3-bbab-19c7fda2fb4b service nova] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_rules [ 718.789767] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-ad4b570d-9bee-45d3-bbab-19c7fda2fb4b service nova] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 718.789958] env[68828]: INFO networking_nsxv3.common.synchronization [req-f5944f2f-ceae-4771-9d16-2272125e4810 req-ad4b570d-9bee-45d3-bbab-19c7fda2fb4b service nova] Enqueued Resource ID: 36a2d676-4da5-411e-bab0-dd33975d5e2d with Priority: HIGHEST for action port [ 718.790586] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_rules [ 718.790760] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 718.790887] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36a2d676-4da5-411e-bab0-dd33975d5e2d with Priority: HIGHEST for action port [ 718.791312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.791471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.791543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.791805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.791918] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.792852] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.792950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.793162] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-36a2d676-4da5-411e-bab0-dd33975d5e2d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.793262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.793324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.793498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.793569] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a2d676-4da5-411e-bab0-dd33975d5e2d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.112815] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 719.113067] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db deletion is rescheduled due to dependency. [ 719.113193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.113363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.113581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.113772] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.113888] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.113955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.114134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.114217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.114303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.114464] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cfee739-816c-4ab2-8883-cdd3c2d159db taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.114541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.114597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.114735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.114872] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.115560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.115560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.115727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.115812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.115896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.115984] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.117463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.117759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.117966] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.118086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.118151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.118307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.118385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.118470] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.295391] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.295542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.295725] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36a2d676-4da5-411e-bab0-dd33975d5e2d with status ACTIVE [ 719.295944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.296091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.296158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.296366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.296453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.296615] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.296701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.296760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.296891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.296969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.297156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.297252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.297321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.297433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.297495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.297600] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36a2d676-4da5-411e-bab0-dd33975d5e2d is going to be updated. [ 719.316526] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.316696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.316748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.316904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.317104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.317209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36a2d676-4da5-411e-bab0-dd33975d5e2d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.618186] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cfee739-816c-4ab2-8883-cdd3c2d159db: rpc.has_security_group_logging(os_id): False [ 719.620250] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.620384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.620452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.620655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.620745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.620956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.621159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.621159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.621564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.621564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.621564] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be updated. [ 719.641612] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.641741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.641741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.641900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.641992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.642189] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.642286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.642370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.642494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.642623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.642774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.642885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.642944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.643098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.643176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.643369] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.643466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.643508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.643644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.643721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.643814] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be updated. [ 719.655412] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.655536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.655762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.655762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.655929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.664924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 719.702702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.702839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.702902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.703165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.703298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.722325] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: IN_PROGRESS for 2s [ 719.735160] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc4eac6a-2c79-4f44-a174-029ee0d0935f req-7ddfa41f-0393-47a3-be28-b3a5451507ef tempest-ServerAddressesNegativeTestJSON-1993261010 tempest-ServerAddressesNegativeTestJSON-1993261010-project-member] Enqueued Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_members [ 719.735475] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_members [ 719.736053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.736177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.736244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.736482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.736634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.736728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.736792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.736929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.737071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.737174] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.038081] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-343 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.038307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.038443] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.038785] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.039060] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.039236] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.039364] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.039583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.039741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.039950] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.040082] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.040358] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.040358] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.040458] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.040517] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.040663] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.058472] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.058617] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.058749] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.058938] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.059268] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-0ab13b9c-4132-4987-a981-663f58995db4 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.059448] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.059604] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.059924] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.060113] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab13b9c-4132-4987-a981-663f58995db4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.238998] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.239171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.239238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.239463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.239553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.239746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.239869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.239924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.240043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.240116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.240215] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e219c53b-e778-4026-be0f-56af2cd314f8 already deleted. [ 720.240287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.565902] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.565902] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 0ab13b9c-4132-4987-a981-663f58995db4 not found, creating... [ 720.565902] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.565902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.566396] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.566396] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.569282] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.569540] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.569725] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.569853] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 0ab13b9c-4132-4987-a981-663f58995db4 is going to be created. [ 720.590750] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.590750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.590750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.590750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.590750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.590750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.709246] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 4s [ 721.375014] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc4eac6a-2c79-4f44-a174-029ee0d0935f req-779ae35b-85c3-4f73-b443-c53d23e5e3b6 service nova] Enqueued Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_rules [ 721.375246] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc4eac6a-2c79-4f44-a174-029ee0d0935f req-779ae35b-85c3-4f73-b443-c53d23e5e3b6 service nova] Enqueued Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_members [ 721.375404] env[68828]: INFO networking_nsxv3.common.synchronization [req-fc4eac6a-2c79-4f44-a174-029ee0d0935f req-779ae35b-85c3-4f73-b443-c53d23e5e3b6 service nova] Enqueued Resource ID: 0ab13b9c-4132-4987-a981-663f58995db4 with Priority: HIGHEST for action port [ 721.378305] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_rules [ 721.378305] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_members [ 721.378305] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab13b9c-4132-4987-a981-663f58995db4 with Priority: HIGHEST for action port [ 721.378305] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.378305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.378305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.378305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.382696] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.382696] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.382696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.382826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.382951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.383083] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.383183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.383649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.383649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.383649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.383765] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.384482] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab13b9c-4132-4987-a981-663f58995db4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.384594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.384721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.384982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.384982] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab13b9c-4132-4987-a981-663f58995db4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.675088] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 721.675269] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db deletion is rescheduled due to dependency. [ 721.675418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.734678] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db in Status: SUCCESS [ 721.735114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.735298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.735651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.735820] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cfee739-816c-4ab2-8883-cdd3c2d159db',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.886817] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.886973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.887209] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.888133] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ab13b9c-4132-4987-a981-663f58995db4 with status ACTIVE [ 721.888336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.888452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.888521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.888747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.888840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.889083] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.889256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.889328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.889510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.889594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.889796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.889892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.889953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.890133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.890297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.890334] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ab13b9c-4132-4987-a981-663f58995db4 is going to be updated. [ 721.909910] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.910078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.910152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.910355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.910492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.910641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab13b9c-4132-4987-a981-663f58995db4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.261282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.261422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.261548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.262526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.262526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.262526] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cfee739-816c-4ab2-8883-cdd3c2d159db is going to be deleted. [ 722.341949] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.342157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.342204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.342796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.342796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.342796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cfee739-816c-4ab2-8883-cdd3c2d159db" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.392213] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.650075] env[68828]: INFO networking_nsxv3.common.synchronization [req-81a4eeb6-6a26-4eb3-a29d-65f0a334f691 req-58950160-20c7-468f-bf23-9709fa7b19fe tempest-ServerRescueTestJSON-1908369248 tempest-ServerRescueTestJSON-1908369248-project-member] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 722.650501] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 722.650828] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.650998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.651067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.651335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.651533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.651648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.651714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.651919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.652059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.652153] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.720293] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.720293] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.720293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.720293] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.897108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.897108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.897108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.897108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.897108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.897108] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e219c53b-e778-4026-be0f-56af2cd314f8 is going to be created. [ 722.933029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.933029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.933029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.933029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.933029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.943026] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e219c53b-e778-4026-be0f-56af2cd314f8 in Status: UNINITIALIZED for 2s [ 723.154951] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.155166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.155233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.155482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.155582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.155787] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.155906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.155970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.156143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.156234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.156432] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b already deleted. [ 723.156540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.222354] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.236023] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.236023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.236023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.236418] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.236746] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.237219] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.237219] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.237460] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.237643] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.237896] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.238044] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.238244] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.238437] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.238585] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.238697] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.238955] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.261041] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.261297] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.261520] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.261739] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.262240] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c6b3b721-262e-4047-93f5-cd974ed3af39 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.262503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.262658] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.263380] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.263582] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b3b721-262e-4047-93f5-cd974ed3af39',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.724915] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.768619] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.768785] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.768896] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.769314] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.769465] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.769631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c6b3b721-262e-4047-93f5-cd974ed3af39 not found, creating... [ 723.769902] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.770076] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.770207] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.770409] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.770641] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.770811] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.770998] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.771985] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.771985] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.771985] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.771985] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c6b3b721-262e-4047-93f5-cd974ed3af39 is going to be created. [ 723.791206] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.791460] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.791562] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.792439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.792793] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.793128] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.227727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.228066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.228066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.228216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.228317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.228418] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 724.253017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.253275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.253350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.253569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.253735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.261904] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 724.518553] env[68828]: INFO networking_nsxv3.common.synchronization [req-81a4eeb6-6a26-4eb3-a29d-65f0a334f691 req-8acc970b-0e45-49e5-84fb-d64fa95492e7 service nova] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_rules [ 724.518730] env[68828]: INFO networking_nsxv3.common.synchronization [req-81a4eeb6-6a26-4eb3-a29d-65f0a334f691 req-8acc970b-0e45-49e5-84fb-d64fa95492e7 service nova] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 724.518925] env[68828]: INFO networking_nsxv3.common.synchronization [req-81a4eeb6-6a26-4eb3-a29d-65f0a334f691 req-8acc970b-0e45-49e5-84fb-d64fa95492e7 service nova] Enqueued Resource ID: c6b3b721-262e-4047-93f5-cd974ed3af39 with Priority: HIGHEST for action port [ 724.519633] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_rules [ 724.519716] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 724.519855] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b3b721-262e-4047-93f5-cd974ed3af39 with Priority: HIGHEST for action port [ 724.520263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.520446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.520548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.520882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.521117] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.522587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.522652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.522777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.523014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.523191] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.523315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.523366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.523586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.523703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.523882] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.524757] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b3b721-262e-4047-93f5-cd974ed3af39 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.524895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.524984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.525184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.525288] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b3b721-262e-4047-93f5-cd974ed3af39',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.951505] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e219c53b-e778-4026-be0f-56af2cd314f8 in Status: SUCCESS [ 724.951804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.951887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.952129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.952322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.952442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.952505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.952684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.952810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.952948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.953108] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.027406] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.027576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.027818] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.028797] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6b3b721-262e-4047-93f5-cd974ed3af39 with status ACTIVE [ 725.029521] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.029521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.029521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.029709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.029785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.030136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.030712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.030712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.030712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.030840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.031053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.031963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.031963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.031963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.031963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.031963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6b3b721-262e-4047-93f5-cd974ed3af39 is going to be updated. [ 725.054493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.054687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.054760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.055218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.055218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.055376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b3b721-262e-4047-93f5-cd974ed3af39" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.455661] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.456012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.456012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.456264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.456444] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.456582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.456669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.456881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.456980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.457090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.457246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.457340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.457401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.457541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.457715] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.457855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.457941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.458103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.458186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.458269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.458395] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.534282] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.960547] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e219c53b-e778-4026-be0f-56af2cd314f8: rpc.has_security_group_logging(os_id): False [ 725.977246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.977432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.977596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.977816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.977910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.978108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.978209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.978273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.978420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.978639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.978730] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.978783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.978843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.978980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.979097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.979278] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.979377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.979450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.979594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.979686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.979781] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e219c53b-e778-4026-be0f-56af2cd314f8 is going to be created. [ 726.034136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.034136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.034136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.034136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.034136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.036586] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.036855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.037019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.037284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.037462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.037642] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be created. [ 726.047724] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e219c53b-e778-4026-be0f-56af2cd314f8 in Status: IN_PROGRESS for 2s [ 726.060303] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.060303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.060303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.060303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.060303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.070023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: UNINITIALIZED for 2s [ 726.272263] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 726.273032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.273032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.273032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.273361] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.273361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.273451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.273699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.273846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.273997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.274154] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.778237] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.778584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.778584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.778749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.778953] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.779071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.779190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.779371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.779525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.779605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.779774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.779859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.779925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.780382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.780382] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.780382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.780382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.780579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.780579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.780672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.780763] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.282902] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f9b2db3-6e42-4115-b9f5-1eac57c03110: rpc.has_security_group_logging(os_id): False [ 727.314206] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.314351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.314424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.314646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.314738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.314943] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.315057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.315120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.315265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.315342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.315517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.315609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.315668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.315802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.315874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.316054] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.316148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.316208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.316381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.316431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.316488] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 727.400108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.400261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.400330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.400544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.400687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.414327] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 728.060070] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e219c53b-e778-4026-be0f-56af2cd314f8 in Status: SUCCESS [ 728.060338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.076316] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 728.076560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.076719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.076957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.077159] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.077277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.077367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.077529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.077609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.077696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.077785] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.580725] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.580945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.580980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.581302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.581487] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.581613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.581679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.581855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.581947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.582063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.582217] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.582321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.582383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.582547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.582693] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.582787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.582847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.582984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.583091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.583176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.583292] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.091514] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d51724-5116-4cde-bbe3-36293e35d81b: rpc.has_security_group_logging(os_id): False [ 729.107992] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.111777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.111944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.112193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.112292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.112540] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.112648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.112712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.112863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.112946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.113190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.113259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.113288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.113432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.113513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.113690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.113822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.113872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.113967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.114152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.114266] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be created. [ 729.168047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.168047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.168047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.168047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.168047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.177154] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 729.427814] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 729.427982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.520949] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 729.521163] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 730.870122] env[68828]: INFO networking_nsxv3.common.synchronization [req-c8f55fce-c6e1-48e3-8628-1c06441ecc01 req-0b0d6b83-130e-4e89-9716-f210cbc8c334 tempest-ListServersNegativeTestJSON-1806494464 tempest-ListServersNegativeTestJSON-1806494464-project-member] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 730.870694] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 730.870994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.871174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.871251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.871447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.871602] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.871700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.871761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.871910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.871985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.874145] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.932946] env[68828]: INFO networking_nsxv3.common.synchronization [req-7f306626-d0a5-4b70-b5b0-448bbcfa28ba req-8bb344fd-a18e-4c35-bb7c-f1cc68696698 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 730.933463] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 730.933715] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.933842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.933909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.934700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.934877] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.934983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.935085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.935244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.935331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.935422] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.189937] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 731.189937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.377427] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.440090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.440090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.440090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.440090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.459208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.459449] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.459570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.459634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.459825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.459910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.459999] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 731.488326] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.488326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.488326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.488326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.488326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.497925] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 731.882031] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.384616] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.384828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.384924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.385139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.385675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.385675] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 732.418605] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.418750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.418824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.419041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.419189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.428809] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 733.205099] env[68828]: INFO networking_nsxv3.common.synchronization [req-42d418c1-77b1-4f77-a0db-025336ebc56d req-77d9fbbe-cfb2-4d0c-9a8b-f017be7bd433 tempest-ServersAdminNegativeTestJSON-1903577502 tempest-ServersAdminNegativeTestJSON-1903577502-project-member] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 733.205099] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 733.205099] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.205099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.205099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.205099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.205993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.206262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.207057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.207361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.207563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.207760] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.508886] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.509526] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.509526] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.510063] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.510414] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.510717] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.514024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.514024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.514024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.514024] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.514024] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.514024] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.514024] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.514024] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.514024] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.514024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.514576] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 733.514950] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 733.515284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.531304] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.531530] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.531710] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.533221] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.533581] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5c75d60d-b669-4a26-a5c6-db7addddbd1d taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.533764] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.533894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.534246] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.534398] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c75d60d-b669-4a26-a5c6-db7addddbd1d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.710335] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.710497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.711014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.711014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.711014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.711178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.711276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.711336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.711483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.711555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.711635] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 already deleted. [ 733.711711] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.037181] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.037465] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.037602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.037884] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.038047] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.038207] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5c75d60d-b669-4a26-a5c6-db7addddbd1d not found, creating... [ 734.038470] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.038661] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.038788] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.039053] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.039218] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.039507] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.039663] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.039782] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.039991] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.042775] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.042998] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5c75d60d-b669-4a26-a5c6-db7addddbd1d is going to be created. [ 734.061317] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.061514] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.061639] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.061891] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.062143] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.064351] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.301263] env[68828]: INFO networking_nsxv3.common.synchronization [None req-98519651-1d36-4422-b49b-99642d850f0f None None] Enqueued Resource ID: c9b68732-1bca-4491-b908-05d182b69966 with Priority: HIGHEST for action port [ 734.301522] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b68732-1bca-4491-b908-05d182b69966 with Priority: HIGHEST for action port [ 734.302111] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9b68732-1bca-4491-b908-05d182b69966 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.302246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9b68732-1bca-4491-b908-05d182b69966" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.302319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9b68732-1bca-4491-b908-05d182b69966" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.302569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9b68732-1bca-4491-b908-05d182b69966" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.302653] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9b68732-1bca-4491-b908-05d182b69966',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.438059] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 734.438283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.805556] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9b68732-1bca-4491-b908-05d182b69966 [ 734.805773] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.805921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.805995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.806236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.806337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.806432] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9b68732-1bca-4491-b908-05d182b69966 already deleted. [ 734.806515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9b68732-1bca-4491-b908-05d182b69966" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.881793] env[68828]: INFO networking_nsxv3.common.synchronization [req-29234cf7-5dfd-4d2e-a750-068a4deb38f1 req-595b0406-634f-41b0-80c5-837e36ad5e40 tempest-ServerAddressesNegativeTestJSON-1993261010 tempest-ServerAddressesNegativeTestJSON-1993261010-project-member] Enqueued Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_members [ 734.881793] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGHEST for action security_group_members [ 734.882142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.882142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.883521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.883521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.883701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.883701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.885623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.885623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.885623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.885623] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.887481] env[68828]: INFO networking_nsxv3.common.synchronization [req-42d418c1-77b1-4f77-a0db-025336ebc56d req-703ff674-9cee-455f-8af2-136de7ffc846 service nova] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_rules [ 734.887773] env[68828]: INFO networking_nsxv3.common.synchronization [req-42d418c1-77b1-4f77-a0db-025336ebc56d req-703ff674-9cee-455f-8af2-136de7ffc846 service nova] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 734.888765] env[68828]: INFO networking_nsxv3.common.synchronization [req-42d418c1-77b1-4f77-a0db-025336ebc56d req-703ff674-9cee-455f-8af2-136de7ffc846 service nova] Enqueued Resource ID: 5c75d60d-b669-4a26-a5c6-db7addddbd1d with Priority: HIGHEST for action port [ 734.889579] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_rules [ 734.889636] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 734.889767] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c75d60d-b669-4a26-a5c6-db7addddbd1d with Priority: HIGHEST for action port [ 734.890336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.890438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.890438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.890773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.890773] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.891587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.892037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.892037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.892037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.892206] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.892206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.892278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.893272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.893272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.893272] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.893564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c75d60d-b669-4a26-a5c6-db7addddbd1d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.893564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.893564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.893683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.895052] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c75d60d-b669-4a26-a5c6-db7addddbd1d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.387982] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.387982] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.387982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.388541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.388541] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e219c53b-e778-4026-be0f-56af2cd314f8 is going to be updated. [ 735.395947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.396151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.396290] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.397440] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c75d60d-b669-4a26-a5c6-db7addddbd1d with status ACTIVE [ 735.397440] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.397697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.397697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.397761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.397815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.398021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.398139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.398190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.398299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.400510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.400510] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.400510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.400510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.400510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.400510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.400510] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c75d60d-b669-4a26-a5c6-db7addddbd1d is going to be updated. [ 735.419650] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.419807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.419898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.420103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.420242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.420397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c75d60d-b669-4a26-a5c6-db7addddbd1d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.422911] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.422911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.422911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.423117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.424237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.432680] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e219c53b-e778-4026-be0f-56af2cd314f8 in Status: IN_PROGRESS for 2s [ 735.818777] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d81928e-1877-44b9-b078-2ceb5f4150ef req-1b7dc688-06c3-4665-871b-acc4522a5f17 tempest-ImagesOneServerTestJSON-1388923083 tempest-ImagesOneServerTestJSON-1388923083-project-member] Enqueued Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_members [ 735.824208] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_members [ 735.825613] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.825613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.825613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.825613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.825613] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.825613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.825613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.826080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.826080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.826080] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.903140] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.133444] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.133739] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-806" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.134051] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-806" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.134628] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-806" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.134628] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.134829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.134998] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.135629] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.135888] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.136158] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.136280] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.136394] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.136508] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.136621] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.136728] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.136856] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.154587] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.154858] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.154941] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.155078] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-806" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.155389] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ba41014d-2073-484a-a2f7-8d74f29f522c taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.155560] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.155665] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.156106] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.156266] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba41014d-2073-484a-a2f7-8d74f29f522c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.329320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.329462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.329534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.329742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.329834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.330026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.330128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.330262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.330328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.330401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.330482] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 already deleted. [ 736.330559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.409525] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.409525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.411873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.411873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.411873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.411873] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be created. [ 736.436958] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.436958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.436958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.436958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.436958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.448849] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: UNINITIALIZED for 2s [ 736.449639] env[68828]: INFO networking_nsxv3.common.synchronization [None req-46b1478c-0c25-4260-af4e-c5ae6b588233 None None] Enqueued Resource ID: 122a11d5-8df1-4ec6-ad0d-82ec8b06611a with Priority: HIGHEST for action port [ 736.450179] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122a11d5-8df1-4ec6-ad0d-82ec8b06611a with Priority: HIGHEST for action port [ 736.450448] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-122a11d5-8df1-4ec6-ad0d-82ec8b06611a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.450569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-122a11d5-8df1-4ec6-ad0d-82ec8b06611a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.450637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-122a11d5-8df1-4ec6-ad0d-82ec8b06611a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.450885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-122a11d5-8df1-4ec6-ad0d-82ec8b06611a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.450966] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('122a11d5-8df1-4ec6-ad0d-82ec8b06611a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.659739] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.660084] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.660201] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.660416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.660549] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.660709] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ba41014d-2073-484a-a2f7-8d74f29f522c not found, creating... [ 736.660972] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.661215] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.661331] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.661816] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.661816] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.661963] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.662122] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.662251] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.662436] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.662608] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.662799] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ba41014d-2073-484a-a2f7-8d74f29f522c is going to be created. [ 736.682031] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.682031] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.682031] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.682362] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.682649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.682918] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.953654] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 122a11d5-8df1-4ec6-ad0d-82ec8b06611a [ 736.953763] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.953903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.953971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.954229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.954327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.954428] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:122a11d5-8df1-4ec6-ad0d-82ec8b06611a already deleted. [ 736.954510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-122a11d5-8df1-4ec6-ad0d-82ec8b06611a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.420850] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d81928e-1877-44b9-b078-2ceb5f4150ef req-bcbcbf2e-d947-49a0-85bf-274cb0df925c service nova] Enqueued Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_rules [ 737.421153] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d81928e-1877-44b9-b078-2ceb5f4150ef req-bcbcbf2e-d947-49a0-85bf-274cb0df925c service nova] Enqueued Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_members [ 737.421153] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d81928e-1877-44b9-b078-2ceb5f4150ef req-bcbcbf2e-d947-49a0-85bf-274cb0df925c service nova] Enqueued Resource ID: ba41014d-2073-484a-a2f7-8d74f29f522c with Priority: HIGHEST for action port [ 737.421378] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_rules [ 737.421510] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_members [ 737.421607] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba41014d-2073-484a-a2f7-8d74f29f522c with Priority: HIGHEST for action port [ 737.422327] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.422450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.422499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.422995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.422995] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.425782] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.425782] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.425782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.425782] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.427409] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba41014d-2073-484a-a2f7-8d74f29f522c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.427522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.427700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.427872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.427952] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba41014d-2073-484a-a2f7-8d74f29f522c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.442516] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e219c53b-e778-4026-be0f-56af2cd314f8 in Status: SUCCESS [ 737.443189] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e219c53b-e778-4026-be0f-56af2cd314f8 deletion is rescheduled due to dependency. [ 737.443332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.925149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.925318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.936483] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.937468] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba41014d-2073-484a-a2f7-8d74f29f522c with status ACTIVE [ 737.938087] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.938087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.938087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.938087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.938302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.938354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.938457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.938523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.938678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.938768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.938945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.939048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.939111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.939308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.939345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.939926] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba41014d-2073-484a-a2f7-8d74f29f522c is going to be updated. [ 737.959308] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.959308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.959497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.959576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.959717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.959875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba41014d-2073-484a-a2f7-8d74f29f522c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.011426] env[68828]: INFO networking_nsxv3.common.synchronization [req-db8c633a-f1c3-4661-a6c9-36049aa22931 req-facb281f-d8c2-4389-8c23-6ca41fd49430 tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_members [ 738.012141] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_members [ 738.012351] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.012469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.012533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.012770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.012931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.013043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.013103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.013281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.013365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.013509] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.441474] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.459730] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 738.459943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.460612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.460612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.460741] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.460856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.460922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.461113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.461279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.461279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.461368] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.513108] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.513321] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.513447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.513708] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.513976] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.514127] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.514248] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.514462] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.514604] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.514808] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.514921] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.515071] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.515211] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.515335] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.515443] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.515589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.516930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.517061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.517131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.517286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.517375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.517549] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.517640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.517719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.517833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.517908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.518067] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 already deleted. [ 738.518067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.534967] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.535149] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.535287] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.535503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-512" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.536066] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-40d358d8-44ea-42c6-bb68-04eaa26a5406 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.536066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.536178] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.536372] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.536509] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d358d8-44ea-42c6-bb68-04eaa26a5406',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.946243] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.946435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.946595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.946678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.946768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.946869] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 is going to be created. [ 738.964732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.964915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.964915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.965149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.965314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.965417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.965472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.965922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.965922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.965922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.965922] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.966140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.966140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.966226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.966357] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.966495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.966573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.966712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.966786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.966869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.966957] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.968646] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.968764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.968812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.968935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.969127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.977951] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 in Status: UNINITIALIZED for 2s [ 739.038856] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.039132] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.039274] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.039555] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.040379] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.040379] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 40d358d8-44ea-42c6-bb68-04eaa26a5406 not found, creating... [ 739.040379] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.040379] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.040668] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.040668] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.040777] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.041059] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.041291] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.041417] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.041617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.041751] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.041890] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 40d358d8-44ea-42c6-bb68-04eaa26a5406 is going to be created. [ 739.060890] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.061161] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.061270] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.061499] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.061716] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.061935] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.471663] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f82e204-74c2-4f16-ab6e-65554153de56: rpc.has_security_group_logging(os_id): False [ 739.497320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.497320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.497320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.497531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.497531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.497726] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.498727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.498727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.499100] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.499100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.499100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.499202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.499233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.499323] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be created. [ 739.569351] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.571478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.571478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.571478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.571478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.583970] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 740.037921] env[68828]: INFO networking_nsxv3.common.synchronization [req-db8c633a-f1c3-4661-a6c9-36049aa22931 req-bec6d18e-7c29-468a-b79d-0aaf7a65f598 service nova] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_rules [ 740.037921] env[68828]: INFO networking_nsxv3.common.synchronization [req-db8c633a-f1c3-4661-a6c9-36049aa22931 req-bec6d18e-7c29-468a-b79d-0aaf7a65f598 service nova] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_members [ 740.037921] env[68828]: INFO networking_nsxv3.common.synchronization [req-db8c633a-f1c3-4661-a6c9-36049aa22931 req-bec6d18e-7c29-468a-b79d-0aaf7a65f598 service nova] Enqueued Resource ID: 40d358d8-44ea-42c6-bb68-04eaa26a5406 with Priority: HIGHEST for action port [ 740.037921] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_rules [ 740.037921] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_members [ 740.037921] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40d358d8-44ea-42c6-bb68-04eaa26a5406 with Priority: HIGHEST for action port [ 740.037921] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.037921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.037921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.037921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.038670] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.041465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.041567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.041635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.041837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.042014] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.042123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.042191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.042344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.042430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.042526] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.043398] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-40d358d8-44ea-42c6-bb68-04eaa26a5406 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.043505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.043574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.047023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.047023] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d358d8-44ea-42c6-bb68-04eaa26a5406',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.541883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.542293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.546363] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.549612] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40d358d8-44ea-42c6-bb68-04eaa26a5406 with status ACTIVE [ 740.549826] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.549962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.550909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.551242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.551431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.551661] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.551773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.551845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.552015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.552264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.552550] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.552818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.552818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.554076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.554076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.554076] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40d358d8-44ea-42c6-bb68-04eaa26a5406 is going to be updated. [ 740.578936] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.578936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.578936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.578936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.578936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.579275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40d358d8-44ea-42c6-bb68-04eaa26a5406" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.988639] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 in Status: SUCCESS [ 740.988933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.989029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.989244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.989427] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.989539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.989604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.989748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.990130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.990259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.990461] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.055838] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.493381] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.493474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.493523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.494690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.494690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.494690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.495118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.495118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.495118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.495118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.495236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.495304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.495378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.495464] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.562031] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.562031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.562031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.563695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.563695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.563695] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 is going to be created. [ 741.589116] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.589519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.589712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.590438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.590724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.597708] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 741.598189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.601315] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: UNINITIALIZED for 2s [ 742.002189] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 448a7f6d-e5f6-4ab8-9c7c-330542177864: rpc.has_security_group_logging(os_id): False [ 742.019746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.019746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.019746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.019746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.019746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.019746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.019746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.020331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.020331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.020331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.020486] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.020632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.020674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.020875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.020995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.021548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.021705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.021799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.022151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.022241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.022333] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 is going to be created. [ 742.075092] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.075240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.075310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.075517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.075695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.085905] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 in Status: IN_PROGRESS for 2s [ 742.130012] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d737b50-5ab1-4ef8-8bb4-75f8c313e12e req-366b255d-2462-47e3-9ff1-18f1fca4bcd4 tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 742.130608] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 742.130917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.132336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.132498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.132955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.133227] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.133389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.133621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.133681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.133784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.133981] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.639473] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.754625] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-165 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.754625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.754625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.754625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.754980] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.755270] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.755415] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.755674] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.755860] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.756100] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.756218] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.756438] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.756438] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.756538] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.756644] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.756797] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.791130] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.791373] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.791510] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.791691] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-165" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.792011] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5a97adca-ad32-4573-bc64-9c729e7d414c taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.792234] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.792365] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.792749] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.792893] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a97adca-ad32-4573-bc64-9c729e7d414c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.140698] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.300194] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.300194] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5a97adca-ad32-4573-bc64-9c729e7d414c not found, creating... [ 743.300194] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.300194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.301293] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.301482] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.301809] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.302099] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.304126] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.304329] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5a97adca-ad32-4573-bc64-9c729e7d414c is going to be created. [ 743.323356] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.323607] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.323744] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.324021] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.324252] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.324491] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.611026] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: SUCCESS [ 743.611164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.611285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.611596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.611692] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.611810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.611904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.612072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.612158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.612249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.612361] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.645691] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.645691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.645691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.645691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.645691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.645691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 743.675687] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.675687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.675687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.675687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.675687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.686958] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 744.098435] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 in Status: SUCCESS [ 744.099263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.117154] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.244530] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d737b50-5ab1-4ef8-8bb4-75f8c313e12e req-50104392-c38b-4f55-9dc0-a87be46174ae service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 744.244713] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d737b50-5ab1-4ef8-8bb4-75f8c313e12e req-50104392-c38b-4f55-9dc0-a87be46174ae service nova] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 744.244854] env[68828]: INFO networking_nsxv3.common.synchronization [req-4d737b50-5ab1-4ef8-8bb4-75f8c313e12e req-50104392-c38b-4f55-9dc0-a87be46174ae service nova] Enqueued Resource ID: 5a97adca-ad32-4573-bc64-9c729e7d414c with Priority: HIGHEST for action port [ 744.245115] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_rules [ 744.245248] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 744.245344] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a97adca-ad32-4573-bc64-9c729e7d414c with Priority: HIGHEST for action port [ 744.245928] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.248246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.248246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.248246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.248246] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.248546] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.248546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.248627] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a97adca-ad32-4573-bc64-9c729e7d414c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.248687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.248719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.248920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.249030] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a97adca-ad32-4573-bc64-9c729e7d414c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.623353] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03: rpc.has_security_group_logging(os_id): False [ 744.648978] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.648978] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.648978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.648978] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 is going to be created. [ 744.706034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.706034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.706034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.706034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.706034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.719932] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: IN_PROGRESS for 2s [ 744.755127] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.755127] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a97adca-ad32-4573-bc64-9c729e7d414c with status ACTIVE [ 744.755127] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.755127] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.755127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.755127] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.755661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.755661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.755661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.755661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.755661] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a97adca-ad32-4573-bc64-9c729e7d414c is going to be updated. [ 744.777063] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.777063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.777063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.777063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.777063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.777063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a97adca-ad32-4573-bc64-9c729e7d414c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.037671] env[68828]: INFO networking_nsxv3.common.synchronization [req-6bce1ac3-05c9-4cd3-8951-57457ae5333b req-d93fe7ec-f3e0-4351-889e-1cc91a310408 tempest-ServersNegativeTestJSON-1274465967 tempest-ServersNegativeTestJSON-1274465967-project-member] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 745.038268] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 745.038578] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.038700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.038777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.039527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.039766] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.039766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.039890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.040553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.040553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.040553] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.549418] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.566741] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.566741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.566741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.566928] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.567342] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.567342] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.567480] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.567633] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.567775] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.568027] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.569378] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.569515] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.569632] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.569759] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.569976] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.570052] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.588165] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.588367] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.588487] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.588670] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.589266] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-4b9fdb8a-2d2f-458f-8c87-76023af07dda taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.589266] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.589430] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.589612] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.589752] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b9fdb8a-2d2f-458f-8c87-76023af07dda',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.700091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.700091] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.700091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.700091] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.756571] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5313e071-c38b-4128-b1bd-5a33b4300990 None None] Enqueued Resource ID: 8ede36ea-b7fd-4aba-b997-0ab27b15a0ed with Priority: HIGHEST for action port [ 745.760603] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ede36ea-b7fd-4aba-b997-0ab27b15a0ed with Priority: HIGHEST for action port [ 745.761340] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ede36ea-b7fd-4aba-b997-0ab27b15a0ed taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.761535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ede36ea-b7fd-4aba-b997-0ab27b15a0ed" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.761617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ede36ea-b7fd-4aba-b997-0ab27b15a0ed" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.761957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ede36ea-b7fd-4aba-b997-0ab27b15a0ed" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.762088] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ede36ea-b7fd-4aba-b997-0ab27b15a0ed',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.052034] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.092515] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.093504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.093504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.093504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.093504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.093860] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 4b9fdb8a-2d2f-458f-8c87-76023af07dda not found, creating... [ 746.093860] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.094120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.094170] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.094635] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.095400] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.096868] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.096868] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.096868] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.096868] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.096868] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.096868] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 4b9fdb8a-2d2f-458f-8c87-76023af07dda is going to be created. [ 746.115680] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.115891] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.116021] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.116329] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.116593] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.117260] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.203769] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.265042] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ede36ea-b7fd-4aba-b997-0ab27b15a0ed [ 746.265507] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.265610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.265689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.265923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.266106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.266237] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ede36ea-b7fd-4aba-b997-0ab27b15a0ed already deleted. [ 746.266498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ede36ea-b7fd-4aba-b997-0ab27b15a0ed" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.556430] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.556598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.556673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.556889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.556982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.557100] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 746.583494] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.583645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.583714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.583928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.584111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.592764] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 746.709199] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.734489] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: SUCCESS [ 746.734489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.041140] env[68828]: INFO networking_nsxv3.common.synchronization [req-6bce1ac3-05c9-4cd3-8951-57457ae5333b req-ebfef19e-6a67-43e2-974e-3bdce9740058 service nova] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_rules [ 747.041140] env[68828]: INFO networking_nsxv3.common.synchronization [req-6bce1ac3-05c9-4cd3-8951-57457ae5333b req-ebfef19e-6a67-43e2-974e-3bdce9740058 service nova] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 747.041140] env[68828]: INFO networking_nsxv3.common.synchronization [req-6bce1ac3-05c9-4cd3-8951-57457ae5333b req-ebfef19e-6a67-43e2-974e-3bdce9740058 service nova] Enqueued Resource ID: 4b9fdb8a-2d2f-458f-8c87-76023af07dda with Priority: HIGHEST for action port [ 747.041140] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_rules [ 747.041140] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 747.042045] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9fdb8a-2d2f-458f-8c87-76023af07dda with Priority: HIGHEST for action port [ 747.043138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.044136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.044136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.045107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.045107] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.048047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.048047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.048047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b9fdb8a-2d2f-458f-8c87-76023af07dda taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.048047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.048047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.048047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.048047] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b9fdb8a-2d2f-458f-8c87-76023af07dda',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.215021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.215021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.215021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.215021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.215021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.215021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 747.244130] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.244130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.244130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.244130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.244130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.253270] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 747.548878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.548878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.550028] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b9fdb8a-2d2f-458f-8c87-76023af07dda with status ACTIVE [ 747.550285] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.550415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.550485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.550688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.551981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.553800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.553920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.553987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.554192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.554280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.554470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.554566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.554628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.554780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.554868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.554955] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b9fdb8a-2d2f-458f-8c87-76023af07dda is going to be updated. [ 747.580465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.580650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.580725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.580935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.581135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.581325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b9fdb8a-2d2f-458f-8c87-76023af07dda" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.349064] env[68828]: INFO networking_nsxv3.common.synchronization [None req-4c425579-6202-4691-ac78-bfa578aad062 None None] Enqueued Resource ID: 6cce1fd8-7941-498f-812c-4d29e22b73a1 with Priority: HIGHEST for action port [ 748.349516] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cce1fd8-7941-498f-812c-4d29e22b73a1 with Priority: HIGHEST for action port [ 748.350476] env[68828]: INFO networking_nsxv3.common.synchronization [req-8d18301b-2784-44ba-bce9-8e105a531eeb req-09f1fd1f-053c-413e-964d-02f8eb065fdf tempest-ServersWithSpecificFlavorTestJSON-1891684402 tempest-ServersWithSpecificFlavorTestJSON-1891684402-project-member] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 748.350779] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cce1fd8-7941-498f-812c-4d29e22b73a1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.350943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cce1fd8-7941-498f-812c-4d29e22b73a1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.350987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cce1fd8-7941-498f-812c-4d29e22b73a1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.351245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cce1fd8-7941-498f-812c-4d29e22b73a1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.351345] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cce1fd8-7941-498f-812c-4d29e22b73a1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.356024] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 748.356024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.356024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.356024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.356024] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.603839] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 748.604073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.604243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.604469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.604688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.604769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.604834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.604992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.605108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.605206] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.853706] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cce1fd8-7941-498f-812c-4d29e22b73a1 [ 748.853994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.854147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.854216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.854422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.854515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.854606] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cce1fd8-7941-498f-812c-4d29e22b73a1 already deleted. [ 748.854689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cce1fd8-7941-498f-812c-4d29e22b73a1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.856168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.857126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.857126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.857126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.883982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.890666] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.890666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.890666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.890666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.890666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.890666] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be updated. [ 748.929661] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.929661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.929661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.929899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.929946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.938287] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: IN_PROGRESS for 2s [ 749.107290] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.184715] env[68828]: INFO networking_nsxv3.common.synchronization [req-febb202e-68ab-44a1-9b42-da2362502f4f req-cb2470e2-84a1-4115-bfbf-37331a945df7 tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 749.184715] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 749.184715] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.184715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.184715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.185088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.186019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.186140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.186210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.186380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.186487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.186563] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.264993] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 749.265332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.265332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.265641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.265703] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.265904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.265904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.266066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.266156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.266228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.266405] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.613814] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.689687] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.692490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.692490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.692490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.713283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.715017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.715017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.715017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.715172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.717494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.717494] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 749.738471] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.738675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.738761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.739560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.739560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.748189] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 749.769463] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.769798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.769798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.770383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.770383] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.770383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.770383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.770533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.770533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.770588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.770808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.770808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.770951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.771180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.771180] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.771327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.771327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.772064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.772064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.772064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.772064] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.117310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.117310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.117310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.117671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.117671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.117671] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 750.153688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.153688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.153688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.153688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.153942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.176805] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 750.229052] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.229352] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.229558] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.229943] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.230951] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.231231] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.231433] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.231775] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.235020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.235020] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.235020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.235020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.235020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.235020] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.235020] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.235020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.276801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.276962] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.277132] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.277307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.277629] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-f5babb0c-d940-4cf4-ae88-a6eb1238c343 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.277795] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.277911] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.278287] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.278425] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5babb0c-d940-4cf4-ae88-a6eb1238c343',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.282101] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6a0522b-dbc3-42bf-8801-b6e755596373: rpc.has_security_group_logging(os_id): False [ 750.304383] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.304596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.304762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.305400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.338586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.338880] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.339016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.339135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.339317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.339397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.339602] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.339705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.339799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.339907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.339982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.340176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.340268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.340325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.340456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.340529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.340614] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 750.402388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.402568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.402641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.402817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.402958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.419351] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 750.783492] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.787024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.787024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.787024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.787024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.787024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port f5babb0c-d940-4cf4-ae88-a6eb1238c343 not found, creating... [ 750.787024] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.787437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.787437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.787569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.787699] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.788124] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.788292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.788409] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.788645] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.788781] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.788925] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: f5babb0c-d940-4cf4-ae88-a6eb1238c343 is going to be created. [ 750.831081] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.831578] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.831761] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.834218] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.835166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.835498] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.953223] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: SUCCESS [ 750.953223] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 deletion is rescheduled due to dependency. [ 750.953223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.437969] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9981809-e098-4c64-b8be-31168eb7d43c req-e404e865-e3f4-4339-81ed-820f5f961a58 tempest-MigrationsAdminTest-1798027422 tempest-MigrationsAdminTest-1798027422-project-member] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 751.438820] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 751.442022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.442022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.442022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.442022] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.759980] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 751.760389] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 751.760517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.835866] env[68828]: INFO networking_nsxv3.common.synchronization [req-febb202e-68ab-44a1-9b42-da2362502f4f req-f2d353b5-cb3b-448b-9743-61a798082657 service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 751.836221] env[68828]: INFO networking_nsxv3.common.synchronization [req-febb202e-68ab-44a1-9b42-da2362502f4f req-f2d353b5-cb3b-448b-9743-61a798082657 service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 751.836413] env[68828]: INFO networking_nsxv3.common.synchronization [req-febb202e-68ab-44a1-9b42-da2362502f4f req-f2d353b5-cb3b-448b-9743-61a798082657 service nova] Enqueued Resource ID: f5babb0c-d940-4cf4-ae88-a6eb1238c343 with Priority: HIGHEST for action port [ 751.837415] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 751.837644] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 751.837847] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5babb0c-d940-4cf4-ae88-a6eb1238c343 with Priority: HIGHEST for action port [ 751.838375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.838616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.838803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.839142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.839347] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.840431] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.843617] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.843617] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.843617] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5babb0c-d940-4cf4-ae88-a6eb1238c343 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.843617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.843617] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5babb0c-d940-4cf4-ae88-a6eb1238c343',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.949246] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.189050] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.189050] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.189050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.189050] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.240243] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.240243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.240243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.240243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.240243] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.240243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.240243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.240753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.241068] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.241440] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.241662] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.242485] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.242485] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.245018] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.245018] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.245018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.260809] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.263026] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.263026] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.263026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.263026] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-61e4ae27-1dcc-48fe-9475-f138fe9380a7 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.263026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.263026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.263870] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.264138] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61e4ae27-1dcc-48fe-9475-f138fe9380a7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.345088] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.346224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.346372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.346741] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5babb0c-d940-4cf4-ae88-a6eb1238c343 with status ACTIVE [ 752.346912] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.347028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.347096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.347594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.348062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.348062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.348062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.348062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.348394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.348394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.348454] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.348547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.348638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.348789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.348869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.348953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5babb0c-d940-4cf4-ae88-a6eb1238c343 is going to be updated. [ 752.369595] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.369782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.369877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.369996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.370149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.370301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5babb0c-d940-4cf4-ae88-a6eb1238c343" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.438124] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 752.438124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.449446] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.691405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.691579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.691631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.692020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.692114] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.692191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.692752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.692752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.692752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.692752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.692752] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.692752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.692982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.692982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.693094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.693183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.693257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.693400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.693467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.693547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.694109] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.766750] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.767185] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.767845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.767845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.768659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.768659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 61e4ae27-1dcc-48fe-9475-f138fe9380a7 not found, creating... [ 752.768659] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.768840] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.768894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.769327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.769498] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.769933] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.769933] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.770089] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.770282] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.770398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.770534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 61e4ae27-1dcc-48fe-9475-f138fe9380a7 is going to be created. [ 752.792429] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.792429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.792429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.792429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.792429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.792429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.847114] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.952301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.953204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.953204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.953204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.953204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.953204] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be updated. [ 752.987236] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.987389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.987465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.987683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.987827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.999496] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 753.196737] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49bff80d-9c54-4a44-a1a9-f388114a1a64: rpc.has_security_group_logging(os_id): False [ 753.222616] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.222755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.222830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.223076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.241547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.241808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.242150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.242150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.242234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.242291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.242490] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.242582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.242645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.242787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.242862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.243052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.243147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.243209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.243401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.243476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.243563] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 753.297547] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.297547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.297547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.297547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.297840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.311247] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 753.350134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.350134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.350134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.350559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.350715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.350819] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 753.394621] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.394793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.394892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.395309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.399016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.407632] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 753.621196] env[68828]: INFO networking_nsxv3.common.synchronization [req-f1251dd1-25b7-4eaf-9825-82d727c6c116 req-71267729-dbfd-42db-a82a-82d0cf835c71 tempest-VolumesAssistedSnapshotsTest-607104416 tempest-VolumesAssistedSnapshotsTest-607104416-project-member] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_members [ 753.621687] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGHEST for action security_group_members [ 753.622250] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.622250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.623833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.623833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.623979] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.624079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.624124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.624597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.624597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.624597] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.682328] env[68828]: INFO networking_nsxv3.common.synchronization [req-7a228f5b-67b3-4d9d-b509-ecbfed96e3cf req-916094a3-5041-48ac-9002-c95202f2a5cb tempest-ServersTestManualDisk-1277052254 tempest-ServersTestManualDisk-1277052254-project-member] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_members [ 753.682839] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGHEST for action security_group_members [ 753.683793] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.683910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.683910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.684127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.684293] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.684394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.684455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.684602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.684690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.684783] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.807619] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9981809-e098-4c64-b8be-31168eb7d43c req-bd2c1690-71e2-478a-9421-26782d83b5b6 service nova] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_rules [ 753.809076] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9981809-e098-4c64-b8be-31168eb7d43c req-bd2c1690-71e2-478a-9421-26782d83b5b6 service nova] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 753.809076] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9981809-e098-4c64-b8be-31168eb7d43c req-bd2c1690-71e2-478a-9421-26782d83b5b6 service nova] Enqueued Resource ID: 61e4ae27-1dcc-48fe-9475-f138fe9380a7 with Priority: HIGHEST for action port [ 753.811327] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_rules [ 753.811327] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 753.811327] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61e4ae27-1dcc-48fe-9475-f138fe9380a7 with Priority: HIGHEST for action port [ 753.814294] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.814425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.814503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.815528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.815528] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.815942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.815998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.820955] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-61e4ae27-1dcc-48fe-9475-f138fe9380a7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.820955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.820955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.820955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.820955] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61e4ae27-1dcc-48fe-9475-f138fe9380a7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.129399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.129399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.129399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.129399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.152926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.153297] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.153445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.153534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.153819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.153961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.154673] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 is going to be updated. [ 754.177730] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.177949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.177949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.178250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.178449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.186173] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f41e17-e083-4115-b3db-6fcd432d4982 in Status: IN_PROGRESS for 2s [ 754.186562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.186772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.186854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.187083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.209113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.209113] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.209113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.209346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.209929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.209929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.209929] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 is going to be updated. [ 754.243194] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.244411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.244411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.244411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.244569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.252312] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 in Status: IN_PROGRESS for 2s [ 754.323532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.323532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.323532] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61e4ae27-1dcc-48fe-9475-f138fe9380a7 with status ACTIVE [ 754.323532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.323532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.323911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.323911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.323911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.324072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.324151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.328022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.328022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.328022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61e4ae27-1dcc-48fe-9475-f138fe9380a7 is going to be updated. [ 754.354557] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.354718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.354767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.354962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.355116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.357236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61e4ae27-1dcc-48fe-9475-f138fe9380a7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.009140] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 755.009406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.009577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.009797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.009991] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.010119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.010195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.010341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.010426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.010518] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.324413] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 755.324740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.422048] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 755.422048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.422048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.422048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.422331] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.422331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.422454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.422676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.422778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.422872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.422990] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.492640] env[68828]: INFO networking_nsxv3.common.synchronization [None req-8886485a-18d0-4e3b-97f0-e6f1fd9a2cde None None] Enqueued Resource ID: 6d38da0c-2984-4a4a-baa3-f1a1d1261529 with Priority: HIGHEST for action port [ 755.493783] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d38da0c-2984-4a4a-baa3-f1a1d1261529 with Priority: HIGHEST for action port [ 755.493783] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d38da0c-2984-4a4a-baa3-f1a1d1261529 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.493783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d38da0c-2984-4a4a-baa3-f1a1d1261529" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.493783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d38da0c-2984-4a4a-baa3-f1a1d1261529" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.494128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d38da0c-2984-4a4a-baa3-f1a1d1261529" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.494170] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d38da0c-2984-4a4a-baa3-f1a1d1261529',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.513418] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.928335] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.929036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.929036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.929036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.929334] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.929402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.929503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.929682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.929774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.929854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.930063] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.930218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.930317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.930481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.930623] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.930714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.930773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.930907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.930983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.931082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.931194] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.996208] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d38da0c-2984-4a4a-baa3-f1a1d1261529 [ 755.996488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.996663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.996744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.996968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.997146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.997315] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d38da0c-2984-4a4a-baa3-f1a1d1261529 already deleted. [ 755.997432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d38da0c-2984-4a4a-baa3-f1a1d1261529" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.014919] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.197511] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f41e17-e083-4115-b3db-6fcd432d4982 in Status: SUCCESS [ 756.197729] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 deletion is rescheduled due to dependency. [ 756.197854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.260969] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 in Status: SUCCESS [ 756.260969] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 deletion is rescheduled due to dependency. [ 756.260969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.437029] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fb8087b-3cde-4101-b157-953a51b3561f: rpc.has_security_group_logging(os_id): False [ 756.451381] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.451534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.451610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.453779] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.453779] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.453779] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.453779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.454216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.454216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.454216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.454216] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 756.517955] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.518153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.518256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.518499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.518611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.518611] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be updated. [ 756.536849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.536944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.537569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.537569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.537569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.550892] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 756.557311] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.557311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.557311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.557311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.557311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.565553] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 757.494718] env[68828]: INFO networking_nsxv3.common.synchronization [None req-f885bd88-79ca-42a7-b065-1b78f4c26a94 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_rules [ 757.494718] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_rules [ 757.494718] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.494718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.494718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.494718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.494718] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.595169] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7a5aca30-78df-45d3-8426-77e1e57c71aa None None] Enqueued Resource ID: 24fb86e0-5bf9-4637-9a74-046f1b61d6b4 with Priority: HIGHEST for action port [ 757.595169] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24fb86e0-5bf9-4637-9a74-046f1b61d6b4 with Priority: HIGHEST for action port [ 757.595619] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-24fb86e0-5bf9-4637-9a74-046f1b61d6b4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.595700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24fb86e0-5bf9-4637-9a74-046f1b61d6b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.595768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24fb86e0-5bf9-4637-9a74-046f1b61d6b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.596018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24fb86e0-5bf9-4637-9a74-046f1b61d6b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.597277] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24fb86e0-5bf9-4637-9a74-046f1b61d6b4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.601539] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6d364fc6-d0aa-4ded-beb7-a3e3e92911ef tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_rules [ 757.601894] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_rules [ 757.602283] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.602509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.015062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.015344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.015344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.016065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.016065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.016065] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d03381a0-8611-467b-849f-03e37e47978c already deleted. [ 758.016065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.016065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.016065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.016423] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.099993] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24fb86e0-5bf9-4637-9a74-046f1b61d6b4 [ 758.100282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.100472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.100628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.100812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.100944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.101104] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24fb86e0-5bf9-4637-9a74-046f1b61d6b4 already deleted. [ 758.101211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24fb86e0-5bf9-4637-9a74-046f1b61d6b4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.539654] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.539989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.539989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.540236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.540335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.540460] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d03381a0-8611-467b-849f-03e37e47978c already deleted. [ 758.540552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.563998] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 758.564276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.579658] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 758.580330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.581848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.581848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.581848] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.089084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.089084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.089084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.089084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.090254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.090254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.090254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.090254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.090254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.090254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.090254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.090837] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.593752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa: rpc.has_security_group_logging(os_id): False [ 759.613789] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.613789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.613789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.613789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.630865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.634199] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.634199] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.634199] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.634199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.634680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.634680] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be updated. [ 759.690330] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.693167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.693167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.693167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.693167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.706298] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 759.842020] env[68828]: INFO networking_nsxv3.common.synchronization [None req-cbbade87-b523-4b34-a285-b3bab3857489 None None] Enqueued Resource ID: 07066331-eaea-4554-9fb6-e82d4f37b03e with Priority: HIGHEST for action port [ 759.842020] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07066331-eaea-4554-9fb6-e82d4f37b03e with Priority: HIGHEST for action port [ 759.843688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-07066331-eaea-4554-9fb6-e82d4f37b03e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.843867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07066331-eaea-4554-9fb6-e82d4f37b03e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.843930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07066331-eaea-4554-9fb6-e82d4f37b03e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.844213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07066331-eaea-4554-9fb6-e82d4f37b03e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.844290] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07066331-eaea-4554-9fb6-e82d4f37b03e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.141652] env[68828]: INFO networking_nsxv3.common.synchronization [req-c212eb51-a439-4081-9ad9-ae1f3b1dfb22 req-ea1a4ee8-126c-436e-b476-41fa99483f0d tempest-ServersNegativeTestJSON-1274465967 tempest-ServersNegativeTestJSON-1274465967-project-member] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 760.142410] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 760.143481] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.143658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.143746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.143995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.144199] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.144313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.144412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.144587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.144680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.144803] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.346417] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07066331-eaea-4554-9fb6-e82d4f37b03e [ 760.346717] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.346857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.346929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.347173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.347267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.347377] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07066331-eaea-4554-9fb6-e82d4f37b03e already deleted. [ 760.347460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07066331-eaea-4554-9fb6-e82d4f37b03e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.651666] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.149934] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.653074] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.653074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.653074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.653448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.653448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.653514] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 761.682512] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.682673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.682673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.682886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.683043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.691583] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 761.717605] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 761.717720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.278463] env[68828]: INFO networking_nsxv3.common.synchronization [None req-64957a01-ff0a-4039-9e14-da362f4619cf None None] Enqueued Resource ID: b2b5e38c-2dbd-42a8-8938-4c034c658d20 with Priority: HIGHEST for action port [ 762.278722] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2b5e38c-2dbd-42a8-8938-4c034c658d20 with Priority: HIGHEST for action port [ 762.279349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2b5e38c-2dbd-42a8-8938-4c034c658d20 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.279443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2b5e38c-2dbd-42a8-8938-4c034c658d20" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.279523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2b5e38c-2dbd-42a8-8938-4c034c658d20" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.279825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2b5e38c-2dbd-42a8-8938-4c034c658d20" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.279915] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b5e38c-2dbd-42a8-8938-4c034c658d20',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.784478] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2b5e38c-2dbd-42a8-8938-4c034c658d20 [ 762.784810] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.784810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.784963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.785698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.785698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.785698] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2b5e38c-2dbd-42a8-8938-4c034c658d20 already deleted. [ 762.785916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2b5e38c-2dbd-42a8-8938-4c034c658d20" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.700571] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 4s [ 764.287745] env[68828]: INFO networking_nsxv3.common.synchronization [req-b70a2cec-80fd-4a56-9669-6032cd66b100 req-b2e7f9bf-e6f2-4cda-8333-377bf11c946d tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 764.288946] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 764.289368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.289557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.289644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.289916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.290120] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.290296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.290342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.290579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.290662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.290793] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.790480] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.790984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-53" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.790984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-53" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.791502] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-53" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.791805] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.791992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.792148] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.792412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.792588] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.792822] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.792943] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.793065] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.793176] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.793288] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.793393] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.793527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.795087] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.795240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.795316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.795490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.795598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.795795] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.795893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.795967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.796151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.796249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.796338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 already deleted. [ 764.796438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.816326] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.816472] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.816569] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.816732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-53" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.817079] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-fd8a70a9-83e9-4c04-8061-dcc0abf67317 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.817260] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.817379] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.817703] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.817851] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd8a70a9-83e9-4c04-8061-dcc0abf67317',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.322155] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.322487] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.322559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.322842] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.322997] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.323174] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port fd8a70a9-83e9-4c04-8061-dcc0abf67317 not found, creating... [ 765.323442] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.323647] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.323755] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.323971] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.324125] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.324405] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.324562] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.324679] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.324886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.325034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.325177] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 is going to be created. [ 765.344475] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.345116] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.345116] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.345229] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.345479] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.346322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.709836] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 765.709913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.175987] env[68828]: INFO networking_nsxv3.common.synchronization [req-b70a2cec-80fd-4a56-9669-6032cd66b100 req-2447480d-5eb0-4fed-9c18-0d143ab41dad service nova] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 766.175987] env[68828]: INFO networking_nsxv3.common.synchronization [req-b70a2cec-80fd-4a56-9669-6032cd66b100 req-2447480d-5eb0-4fed-9c18-0d143ab41dad service nova] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 766.175987] env[68828]: INFO networking_nsxv3.common.synchronization [req-b70a2cec-80fd-4a56-9669-6032cd66b100 req-2447480d-5eb0-4fed-9c18-0d143ab41dad service nova] Enqueued Resource ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 with Priority: HIGHEST for action port [ 766.175987] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 766.175987] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 766.175987] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 with Priority: HIGHEST for action port [ 766.176376] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.176615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.176765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.177066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.177242] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.178355] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.178694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.178854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.179131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.179596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.179805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.179952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.180187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.180365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.180539] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.182238] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd8a70a9-83e9-4c04-8061-dcc0abf67317 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.182238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.182238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.182238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.183063] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd8a70a9-83e9-4c04-8061-dcc0abf67317',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.687667] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd8a70a9-83e9-4c04-8061-dcc0abf67317 with status ACTIVE [ 766.687667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.687667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.687667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.687667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.687667] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 is going to be updated. [ 766.689313] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.691245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.691245] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.708771] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.708942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.709076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.709211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.709348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.709511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.989773] env[68828]: INFO networking_nsxv3.common.synchronization [req-273a03f7-c808-4e15-8104-0234cd18e31f req-1eb213d8-c767-4c36-97e8-146835a5ab19 tempest-ServersV294TestFqdnHostnames-978881238 tempest-ServersV294TestFqdnHostnames-978881238-project-member] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_members [ 766.989773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGHEST for action security_group_members [ 766.989773] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.989773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.989773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.989773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.990208] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.990208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.990208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.990208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.990398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.990398] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.194298] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.269594] env[68828]: INFO networking_nsxv3.common.synchronization [req-ccbb6cd8-ee83-43fe-a00e-edc1537b4022 req-d64eae4a-fe36-4938-b7ae-145bec0e9389 tempest-ServersTestFqdnHostnames-595117522 tempest-ServersTestFqdnHostnames-595117522-project-member] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_members [ 767.270103] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGHEST for action security_group_members [ 767.270399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.270521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.270586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.270783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.270952] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.271082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.271139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.271382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.271511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.272253] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.493333] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.493473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.493523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.493741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.522744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.523017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.523171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.523239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.523823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.523823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.523823] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c is going to be updated. [ 767.547872] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.548162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.548296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.548627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.548860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.564785] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c in Status: IN_PROGRESS for 2s [ 767.696201] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.696201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.696492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.696492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.696603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.696668] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be created. [ 767.724983] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.725171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.725245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.725469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.725621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.734550] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: UNINITIALIZED for 2s [ 767.775498] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.775498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.775498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.775498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.796995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.799018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.799018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.799018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.799018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.799018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.799018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 is going to be updated. [ 767.824450] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.826483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.826760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.827254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.827527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.840877] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 in Status: IN_PROGRESS for 2s [ 769.573953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c in Status: SUCCESS [ 769.573953] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c deletion is rescheduled due to dependency. [ 769.573953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.743214] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 769.743451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.743630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.743859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.744065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.744200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.744300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.744534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.744635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.744768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.744925] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.853992] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 in Status: SUCCESS [ 769.855022] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 deletion is rescheduled due to dependency. [ 769.855022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.248745] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.752477] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61fe50ff-0f58-47fa-9ef5-7eec076d9a64: rpc.has_security_group_logging(os_id): False [ 770.771049] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.771049] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.771049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.772057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.772340] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be created. [ 770.830053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.830209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.830314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.830564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.830839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.844047] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: IN_PROGRESS for 2s [ 771.258017] env[68828]: INFO networking_nsxv3.common.synchronization [req-ee60af73-3153-4693-9138-50aa356a9926 req-39c89c1f-7be3-4c36-b68c-b758a5f040f6 tempest-ListServersNegativeTestJSON-1806494464 tempest-ListServersNegativeTestJSON-1806494464-project-member] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 771.258017] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 771.258017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.258017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.258017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.258017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.258017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.258017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.258017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.258418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.258418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.258418] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.460039] env[68828]: INFO networking_nsxv3.common.synchronization [req-0b197166-9977-41b3-9aa9-8132daa2aaf2 req-9d685d46-a643-4b14-8bd5-44760f853bcc tempest-ListServersNegativeTestJSON-1806494464 tempest-ListServersNegativeTestJSON-1806494464-project-member] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 771.460600] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGHEST for action security_group_members [ 771.461292] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.461427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.761087] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.262950] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.765254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.765543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.765581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.765814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.765910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.766030] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 772.794030] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.794030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.794030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.794030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.794030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.796205] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9a860c2-7e15-4463-9cee-f300148c30dc req-6aa7c1bf-4fdd-44b4-b8d9-96e998890944 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 772.797596] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 772.798087] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.798372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.798523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.798835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.799187] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.799482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.799686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.799957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.800166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.800362] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.804322] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 772.856662] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 772.857130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.141092] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.141092] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.141092] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.141092] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.141338] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.141338] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.141482] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.141828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.141828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.146092] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.149015] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.149015] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.149015] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.149015] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.149015] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.149015] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.167910] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.168095] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.168237] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.168414] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.168732] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-988d2b98-cc47-413e-9636-ee40f2df3181 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.168914] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.169051] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.169439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.169606] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988d2b98-cc47-413e-9636-ee40f2df3181',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.247400] env[68828]: INFO networking_nsxv3.common.synchronization [req-f063b746-942d-4b5a-b95e-2dadb40418aa req-cb5924cb-32a0-4eb3-965a-9c2c4b8a76a9 tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 773.247970] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 773.248299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.248431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.248512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.248726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.249107] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.249107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.249486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.249699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.249797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.249910] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.303763] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.303894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.303987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.304244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.304343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.304554] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.304675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.304737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.304881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.304982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.305056] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c already deleted. [ 773.305142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.671901] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.672159] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.672292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.672636] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.672793] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.672963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 988d2b98-cc47-413e-9636-ee40f2df3181 not found, creating... [ 773.673271] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.673431] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.673573] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.673828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.674350] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.674350] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.674498] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.674557] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.674775] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.674915] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.675070] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 988d2b98-cc47-413e-9636-ee40f2df3181 is going to be created. [ 773.694274] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.694478] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.694603] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.694930] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.695189] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.695422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.753467] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.753730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.753806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.754037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.754137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.754346] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.754444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.754521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.754672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.754750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.754837] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 773.798237] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.798541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.798541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.798645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.798784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.807679] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 773.909833] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 773.909833] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:1 started [ 774.398569] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9a860c2-7e15-4463-9cee-f300148c30dc req-6826b784-35be-42bd-942a-530b64c4604b service nova] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 774.401150] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9a860c2-7e15-4463-9cee-f300148c30dc req-6826b784-35be-42bd-942a-530b64c4604b service nova] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 774.401150] env[68828]: INFO networking_nsxv3.common.synchronization [req-f9a860c2-7e15-4463-9cee-f300148c30dc req-6826b784-35be-42bd-942a-530b64c4604b service nova] Enqueued Resource ID: 988d2b98-cc47-413e-9636-ee40f2df3181 with Priority: HIGHEST for action port [ 774.401150] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 774.401150] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 774.401150] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988d2b98-cc47-413e-9636-ee40f2df3181 with Priority: HIGHEST for action port [ 774.403610] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.403745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.403843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.406776] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.406776] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.406776] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.406776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.406776] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.409330] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-988d2b98-cc47-413e-9636-ee40f2df3181 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.409432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.409504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.409659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.409737] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988d2b98-cc47-413e-9636-ee40f2df3181',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.815171] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.815171] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.815171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.815171] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.912264] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 988d2b98-cc47-413e-9636-ee40f2df3181 with status ACTIVE [ 774.912455] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.912591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.912652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.912872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.912964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.913155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.913610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.913610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.913610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.913610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.913861] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.913861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.913861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.914059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.914220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.914325] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 988d2b98-cc47-413e-9636-ee40f2df3181 is going to be updated. [ 774.915679] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.916596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.916722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.936556] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.936786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.936786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.936968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.937123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.937371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.319052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.319052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.319052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.319191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.319229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.322829] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.322829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.322829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.322829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.322829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.322829] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be updated. [ 775.351094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.351094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.351094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.351094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.351524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.361732] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: IN_PROGRESS for 2s [ 775.418136] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.523718] env[68828]: INFO networking_nsxv3.common.synchronization [req-8af79a84-1fe3-45b5-a267-d2e044cb785d req-e8b6a96c-009f-4ba6-b678-6de3b2e23362 tempest-ServerPasswordTestJSON-1596041620 tempest-ServerPasswordTestJSON-1596041620-project-member] Enqueued Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_members [ 775.524280] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_members [ 775.524585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.524712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.524781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.525546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.525747] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.525877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.525944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.526124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.526292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.526399] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.825758] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 775.825758] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 775.825758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.830322] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-243" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-243" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-243" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.830322] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.830322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.830322] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.830322] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.830322] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.830322] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.831212] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.831212] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.831212] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.852068] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.852068] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.852304] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.852480] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-243" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.852820] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-94de9065-2747-4fe2-bb9e-30c31fb11ef8 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.853069] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.853225] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.853571] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.853778] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94de9065-2747-4fe2-bb9e-30c31fb11ef8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.924536] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.924742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.924801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.925536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.926039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.926183] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be created. [ 775.953129] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.953129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.953129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.953129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.953404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.962253] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: UNINITIALIZED for 2s [ 776.028879] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.029070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.029354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.029354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.029468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.029654] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.029764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.029824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.029967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.030054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.030452] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 already deleted. [ 776.030452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.356991] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.357309] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.357536] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.357737] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.357893] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.358104] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 94de9065-2747-4fe2-bb9e-30c31fb11ef8 not found, creating... [ 776.358400] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.358579] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.358728] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.358973] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.359222] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.359799] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.359799] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.360016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.360176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.361439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.361439] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 94de9065-2747-4fe2-bb9e-30c31fb11ef8 is going to be created. [ 776.380292] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.380609] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.380609] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.383504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.383504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.383504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.119592] env[68828]: INFO networking_nsxv3.common.synchronization [req-8af79a84-1fe3-45b5-a267-d2e044cb785d req-a2287cde-c6ac-4b91-a57b-62a9aef50dd8 service nova] Enqueued Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_rules [ 777.119878] env[68828]: INFO networking_nsxv3.common.synchronization [req-8af79a84-1fe3-45b5-a267-d2e044cb785d req-a2287cde-c6ac-4b91-a57b-62a9aef50dd8 service nova] Enqueued Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_members [ 777.120253] env[68828]: INFO networking_nsxv3.common.synchronization [req-8af79a84-1fe3-45b5-a267-d2e044cb785d req-a2287cde-c6ac-4b91-a57b-62a9aef50dd8 service nova] Enqueued Resource ID: 94de9065-2747-4fe2-bb9e-30c31fb11ef8 with Priority: HIGHEST for action port [ 777.120787] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_rules [ 777.121061] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_members [ 777.121061] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94de9065-2747-4fe2-bb9e-30c31fb11ef8 with Priority: HIGHEST for action port [ 777.121301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.121443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.121515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.121763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.121926] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.123257] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.123838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.124475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.124475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.124475] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.124689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.124773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.125323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.125323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.125323] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.127058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-94de9065-2747-4fe2-bb9e-30c31fb11ef8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.127194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.127301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.127493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.127603] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94de9065-2747-4fe2-bb9e-30c31fb11ef8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.371925] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 in Status: SUCCESS [ 777.372134] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 deletion is rescheduled due to dependency. [ 777.372245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.624229] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.624229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.628316] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.631585] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94de9065-2747-4fe2-bb9e-30c31fb11ef8 with status ACTIVE [ 777.631585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.631585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.631585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.631585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.631585] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94de9065-2747-4fe2-bb9e-30c31fb11ef8 is going to be updated. [ 777.652284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.652284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.653959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.653959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.653959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.653959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94de9065-2747-4fe2-bb9e-30c31fb11ef8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.972235] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 777.972617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.972617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.972761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.972965] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.973709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.973709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.973709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.973709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.973709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.973709] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.130997] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.479029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.479029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479879] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.632653] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.633167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.633167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.633167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.633289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.633374] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 is going to be created. [ 778.658192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.658336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.658408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.658612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.658771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.670652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: UNINITIALIZED for 2s [ 778.982479] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9050286-eb81-4cbb-9bd8-733baee0e20c: rpc.has_security_group_logging(os_id): False [ 779.002290] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.002518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.002518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.002705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.002858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.002988] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.003100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.003168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.003368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.003368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.003561] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.003677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.003793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.003848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.003902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.004103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.004207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.004262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.004402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.004476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.004561] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be created. [ 779.062553] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.062553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.062719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.063408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.063408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.086941] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 780.680223] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: UNINITIALIZED for 4s [ 780.746024] env[68828]: INFO networking_nsxv3.common.synchronization [req-530e1477-c121-4f5d-807e-6abb5b07d5af req-25ca8817-0968-4b97-a080-5b2dfd373fcc tempest-ServerDiagnosticsTest-2092774002 tempest-ServerDiagnosticsTest-2092774002-project-member] Enqueued Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_members [ 780.746024] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_members [ 780.746024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.746024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.746393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.746435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.746669] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.746832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.746897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.747116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.747236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.747364] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.099219] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 781.099522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.186701] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.186924] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.187624] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.187624] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.187624] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.187925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.187925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.188137] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.188298] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.188521] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.188690] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.188756] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.189126] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.189277] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.189399] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.189553] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.207563] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.207764] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 781.207919] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.208153] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.208526] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.208729] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.208856] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.209230] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.209361] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35ed887d-6a80-4b21-ba1f-2de3f1f92f0f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.252149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.252329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.252475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.253083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.253083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.253215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.253321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.253398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.253584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.253746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.253874] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee881f3c-d61c-4373-931c-252d84c5ac2b already deleted. [ 781.254019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.713863] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.713863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.713863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.713863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.713863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.713863] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 35ed887d-6a80-4b21-ba1f-2de3f1f92f0f not found, creating... [ 781.713863] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.713863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.713863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.714494] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.714494] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.714494] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.714602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.715164] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.715312] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.715541] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.715715] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 35ed887d-6a80-4b21-ba1f-2de3f1f92f0f is going to be created. [ 781.737165] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.737559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.737559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.738371] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.738371] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.738371] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.528617] env[68828]: INFO networking_nsxv3.common.synchronization [req-530e1477-c121-4f5d-807e-6abb5b07d5af req-c2fe4cc6-994d-4b70-a3a7-732d50daf2bc service nova] Enqueued Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_rules [ 782.528852] env[68828]: INFO networking_nsxv3.common.synchronization [req-530e1477-c121-4f5d-807e-6abb5b07d5af req-c2fe4cc6-994d-4b70-a3a7-732d50daf2bc service nova] Enqueued Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_members [ 782.529075] env[68828]: INFO networking_nsxv3.common.synchronization [req-530e1477-c121-4f5d-807e-6abb5b07d5af req-c2fe4cc6-994d-4b70-a3a7-732d50daf2bc service nova] Enqueued Resource ID: 35ed887d-6a80-4b21-ba1f-2de3f1f92f0f with Priority: HIGHEST for action port [ 782.529703] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_rules [ 782.529865] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_members [ 782.530012] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35ed887d-6a80-4b21-ba1f-2de3f1f92f0f with Priority: HIGHEST for action port [ 782.532947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.533098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.533169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.533435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.533553] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.535359] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.535482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.535555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.535743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.535894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.535990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.536064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.536263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.536317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.536402] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.538223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.538223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.538223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.538223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.538223] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35ed887d-6a80-4b21-ba1f-2de3f1f92f0f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.691924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: SUCCESS [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.691924] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.691924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.692591] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.040190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.040190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.041357] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.042321] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35ed887d-6a80-4b21-ba1f-2de3f1f92f0f with status ACTIVE [ 783.042543] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.042661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.042744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.042940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.043036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.043202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.043294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.043352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.043523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.043602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.043778] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.043859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.043917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.044060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.044169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.044204] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35ed887d-6a80-4b21-ba1f-2de3f1f92f0f is going to be updated. [ 783.068103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.068246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.068318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.068523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.068657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.069115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35ed887d-6a80-4b21-ba1f-2de3f1f92f0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.197663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.197910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.198045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.198349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.198594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.198754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.198850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.199067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.199338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.199338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.199612] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.199758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.199854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.200076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.200336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.200466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.200546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.200737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.200898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.201029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.203142] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.431371] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 783.431571] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 783.432083] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 783.432221] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 783.432524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.432652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.432717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.432967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.435311] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.435488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.435584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.435669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.435759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.435856] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.440020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.440020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.440020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.440020] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.483027] env[68828]: INFO networking_nsxv3.common.synchronization [req-9ac00993-241a-4a7d-8685-61d1ae1d7fe4 req-271ca6b4-e0ab-4933-b246-e21048a5a3db tempest-VolumesAdminNegativeTest-51626435 tempest-VolumesAdminNegativeTest-51626435-project-member] Enqueued Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_members [ 783.483823] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_members [ 783.483823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.484014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.484014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.484207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.484369] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.484466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.484518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.484662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.484746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.484838] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.551042] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.708119] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9cd372-4403-4f1e-910f-c55839944672: rpc.has_security_group_logging(os_id): False [ 783.725215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.725419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.725476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.725730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.725998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.726292] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.726416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.726416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.726580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.726656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.726989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.727113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.727196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.727346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.727424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.727630] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.727737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.727801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.727957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.728055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.728145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 is going to be created. [ 783.764477] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_rules [ 783.764658] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 783.764795] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 783.764925] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 783.765066] env[68828]: INFO networking_nsxv3.common.synchronization [req-cbd1946d-cc66-42ad-8c97-47045aa351c4 req-102dcdf0-b3e5-41e8-ab76-c2eaa759a991 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 988d2b98-cc47-413e-9636-ee40f2df3181 with Priority: HIGHEST for action port [ 783.765587] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_rules [ 783.765735] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 783.765831] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988d2b98-cc47-413e-9636-ee40f2df3181 with Priority: HIGHEST for action port [ 783.765921] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 783.766020] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 783.766289] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.766412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.766470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.766719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.766846] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.770082] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.770082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.770082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.770082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.770082] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.770082] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-988d2b98-cc47-413e-9636-ee40f2df3181 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.770082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.770082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.770082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.770082] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988d2b98-cc47-413e-9636-ee40f2df3181',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.770624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.770698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.770886] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.770945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.778611] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.778739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.778834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.779033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.779359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.789154] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: IN_PROGRESS for 2s [ 783.942366] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.942717] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.990131] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.990288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.990459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.990600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.990691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.990868] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.990968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.991030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.991159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.991239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.991319] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 already deleted. [ 783.991395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.053789] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.054122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.054122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.054278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.054369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.054466] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee881f3c-d61c-4373-931c-252d84c5ac2b is going to be created. [ 784.075944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.076178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.076178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.076357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.076512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.086150] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee881f3c-d61c-4373-931c-252d84c5ac2b in Status: UNINITIALIZED for 2s [ 784.268246] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.268477] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.268609] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.268969] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.269392] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.269630] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.269833] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.270099] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.270275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.270539] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.270685] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.270802] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.270910] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.271033] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.271141] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.271272] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.273129] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.273253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.273548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.273670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.274099] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 988d2b98-cc47-413e-9636-ee40f2df3181 with status ACTIVE [ 784.274233] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.274377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.274463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.274640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.274767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.274963] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.275118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.275220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.275456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.275601] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.275922] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.276183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.276183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.276307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.276385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.276473] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 988d2b98-cc47-413e-9636-ee40f2df3181 is going to be updated. [ 784.295448] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.295626] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.295770] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.295956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-691" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.296290] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5f45620f-c339-4f54-a883-4f9f45b1278d taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.296466] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.296586] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.297042] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.297042] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f45620f-c339-4f54-a883-4f9f45b1278d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.302701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.302701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.302701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.302701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.302701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.302701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.435635] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2455556-aac1-4452-969d-51a14d3bcfb5 req-f8efd400-c86a-4924-afa8-601cb51c1bba tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 784.437017] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 784.437017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.437017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.437017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.437017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.437017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.438278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.438379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.438564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.438636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.439671] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.443469] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.445526] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.701068] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_members [ 784.701068] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 784.701068] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 784.701068] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_members [ 784.701068] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 784.701068] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 784.701987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.702343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.702580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.702991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.703322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.703646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.703848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.704146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.704371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.704590] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.708025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.708025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.708025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.708025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.791342] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_rules [ 784.791342] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 784.791342] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_rules [ 784.791342] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_members [ 784.791829] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 784.792604] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 784.793650] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc87767c-6f94-494c-b44a-4a44af8eb7bd req-a5374cbb-75cf-4901-bf0a-c1ee88ac9831 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 988d2b98-cc47-413e-9636-ee40f2df3181 with Priority: HIGHEST for action port [ 784.795186] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_rules [ 784.795186] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_rules [ 784.795186] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 784.795186] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988d2b98-cc47-413e-9636-ee40f2df3181 with Priority: HIGHEST for action port [ 784.795530] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 784.795638] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 784.795807] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_members [ 784.796612] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.796964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.797190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.798035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.798035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.798035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.798035] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.802592] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.802825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.803195] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-988d2b98-cc47-413e-9636-ee40f2df3181 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.803416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.803580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.803932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.804115] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('988d2b98-cc47-413e-9636-ee40f2df3181',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.806363] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.807191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.807191] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.807191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.807492] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.807492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.809029] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.809029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.809293] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.809572] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.810300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.810300] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5f45620f-c339-4f54-a883-4f9f45b1278d not found, creating... [ 784.810639] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.812731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.812731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.812731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.812731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.812731] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.812731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.812731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.813230] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.814271] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.814271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5f45620f-c339-4f54-a883-4f9f45b1278d is going to be created. [ 784.835081] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.835290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.835412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.835689] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.837533] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.837533] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.852809] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.853295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.853295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.853512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.853566] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.942696] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.946421] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.946756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.946835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.947061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.947157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.947257] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be created. [ 784.948603] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.948733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.948780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.949188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.949188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.949188] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 784.981082] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.981082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.981243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.981838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.981838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.002191] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.002340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.002380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.003806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.003806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.004463] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: UNINITIALIZED for 2s [ 785.010647] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 785.208122] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.303015] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.303197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.306598] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 988d2b98-cc47-413e-9636-ee40f2df3181 with status ACTIVE [ 785.306790] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.306907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.306976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.307207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.307300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.307462] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.307558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.307621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.307771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.307855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.308057] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.308154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.308215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.308352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.308429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.309249] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 988d2b98-cc47-413e-9636-ee40f2df3181 is going to be updated. [ 785.327964] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.328112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.328172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.328344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.328481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.328631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-988d2b98-cc47-413e-9636-ee40f2df3181" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.356189] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.444444] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.710045] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.749718] env[68828]: INFO networking_nsxv3.common.synchronization [req-9ac00993-241a-4a7d-8685-61d1ae1d7fe4 req-381d581b-6456-4d09-9b3c-79a42c85850f service nova] Enqueued Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_rules [ 785.749968] env[68828]: INFO networking_nsxv3.common.synchronization [req-9ac00993-241a-4a7d-8685-61d1ae1d7fe4 req-381d581b-6456-4d09-9b3c-79a42c85850f service nova] Enqueued Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_members [ 785.750049] env[68828]: INFO networking_nsxv3.common.synchronization [req-9ac00993-241a-4a7d-8685-61d1ae1d7fe4 req-381d581b-6456-4d09-9b3c-79a42c85850f service nova] Enqueued Resource ID: 5f45620f-c339-4f54-a883-4f9f45b1278d with Priority: HIGHEST for action port [ 785.750488] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_rules [ 785.750488] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_members [ 785.750488] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f45620f-c339-4f54-a883-4f9f45b1278d with Priority: HIGHEST for action port [ 785.751941] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.752148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.752233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.752477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.752579] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.753662] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.753662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.753662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.753821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.753821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.753929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.753988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.754148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.754232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.754316] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.757960] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f45620f-c339-4f54-a883-4f9f45b1278d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.757960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.757960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.757960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.757960] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f45620f-c339-4f54-a883-4f9f45b1278d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.809035] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: SUCCESS [ 785.809035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.860043] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.946687] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.947060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.947060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.947216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.947216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.947313] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 785.973262] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.973402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.975121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.975121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.975121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.981630] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 786.096748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee881f3c-d61c-4373-931c-252d84c5ac2b in Status: SUCCESS [ 786.096748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.096927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.097945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.097945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.097945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.097945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.097945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.097945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.097945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.097945] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.212421] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.212780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.212825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.213043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.213203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.213259] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 is going to be created. [ 786.234723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.234860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.234930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.235154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.235357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.244913] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: UNINITIALIZED for 2s [ 786.257807] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.257807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.257807] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.258638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f45620f-c339-4f54-a883-4f9f45b1278d with status ACTIVE [ 786.258830] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.258956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.259023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.259219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.259307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.259570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.259669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.259728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.261443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.261443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.262210] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.262334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.262391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.262544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.262616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.266017] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f45620f-c339-4f54-a883-4f9f45b1278d is going to be updated. [ 786.282383] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.282543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.282628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.282822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.282946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.283113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f45620f-c339-4f54-a883-4f9f45b1278d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.366116] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 786.366246] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 786.601987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.602205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.602248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.602589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.602758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.602862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.602928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.603456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.603594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.603719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.603931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.604071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.604185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.604401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.604621] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.604803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.604859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.605050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.605159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.605313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.605447] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.766241] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.014178] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 787.014457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.014667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.014930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.015188] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.015367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.015479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.015696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.015916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.016220] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.029662] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 787.029879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.030567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.030791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.030984] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.031131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.031199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.031354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.031437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.031658] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.111868] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee881f3c-d61c-4373-931c-252d84c5ac2b: rpc.has_security_group_logging(os_id): False [ 787.128528] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.128720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.128810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.129072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.129185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.129423] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.129542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.129607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.129782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.129864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.130288] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.130403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.130472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.130637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.130716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.130893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.130985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.131056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.131192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.131265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.131349] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee881f3c-d61c-4373-931c-252d84c5ac2b is going to be created. [ 787.218962] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.219258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.219258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.219433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.219645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.230062] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee881f3c-d61c-4373-931c-252d84c5ac2b in Status: IN_PROGRESS for 2s [ 787.268732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.268899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.268975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.269207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.269299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.269400] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 is going to be created. [ 787.304592] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.304817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.304817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.304941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.305106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.322054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 in Status: UNINITIALIZED for 2s [ 787.384716] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.384851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.384851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.385078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.397704] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 787.398592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.399493] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 787.427084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.427313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.427355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.427543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.433754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.434243] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 787.434339] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.434405] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 787.482648] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.482793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.485008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.485008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.485008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.485008] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 787.519563] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.535548] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.567701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.567795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.568057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.568281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.568497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.568732] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 787.663052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.663212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.663283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.663509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.663762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.663976] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 787.664098] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1bb85f31-5e65-47cb-bc60-aada80785442', 'bfa5a1fe-085f-464d-8f13-c58c1c0ee85a', '7f82e204-74c2-4f16-ab6e-65554153de56', '61fe50ff-0f58-47fa-9ef5-7eec076d9a64', '29278155-2b69-484f-b19d-598dcb421e94', 'bc128506-c5e7-4179-a805-6679a20e9957', '3fdb4832-fb6b-46dc-9929-5e545ccfc219', '48d51724-5116-4cde-bbe3-36293e35d81b', 'd6e8b4d0-5c3c-49d7-818c-d81ddf51bc03', 'f4b3f009-4ef7-4a2c-9670-9235fef4370e', 'a8e993f1-ee06-4325-98b9-4dc8467a2fb3', '65ecb6f4-7309-401b-a695-1d6786a18c4b', '1e5d8d96-221b-4bfb-a293-1aa1d5812bf3', '70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c', '1c9cd372-4403-4f1e-910f-c55839944672', '4fb8087b-3cde-4101-b157-953a51b3561f', '0f9b2db3-6e42-4115-b9f5-1eac57c03110', 'e219c53b-e778-4026-be0f-56af2cd314f8', '44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa', '185198c9-6b76-40ca-9634-3cee48a72a6d', 'd71fe85b-2b15-476f-8dc2-6739692bced0', 'c55eb713-452e-4803-84ae-58a048b5a359', '55fbd6f6-2090-4d92-ac03-c7ce1819a7d1', '49bff80d-9c54-4a44-a1a9-f388114a1a64', '6547eb98-d904-4822-951d-00fe16de337d', 'f9050286-eb81-4cbb-9bd8-733baee0e20c', 'e6a0522b-dbc3-42bf-8801-b6e755596373', '7c70394b-e7ce-40e9-946e-b190f72998f8', 'd681bb4b-ff28-46df-b3fb-b660a07ce6c2', '448a7f6d-e5f6-4ab8-9c7c-330542177864', 'ee881f3c-d61c-4373-931c-252d84c5ac2b', '0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff', 'e9f41e17-e083-4115-b3db-6fcd432d4982'} {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.664192] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 787.683349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.683575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.683575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.683815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.683893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.683941] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 787.684025] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.684091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 787.755830] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.756094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.756259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.756434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.757329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.757637] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 787.757745] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 787.757864] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 787.757974] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 787.758083] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 787.758175] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGH for action security_group_rules [ 787.758283] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGH for action security_group_rules [ 787.758375] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGH for action security_group_rules [ 787.758457] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGH for action security_group_rules [ 787.758543] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGH for action security_group_rules [ 787.758642] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGH for action security_group_rules [ 787.758723] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGH for action security_group_rules [ 787.758802] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGH for action security_group_rules [ 787.758902] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGH for action security_group_rules [ 787.758984] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGH for action security_group_rules [ 787.759083] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGH for action security_group_rules [ 787.759152] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGH for action security_group_rules [ 787.759256] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGH for action security_group_rules [ 787.759329] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGH for action security_group_rules [ 787.759399] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGH for action security_group_rules [ 787.759649] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGH for action security_group_rules [ 787.759842] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGH for action security_group_rules [ 787.759954] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGH for action security_group_rules [ 787.760083] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGH for action security_group_rules [ 787.760154] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGH for action security_group_rules [ 787.760277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.992374] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 787.992645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.024202] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.038286] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.254495] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: SUCCESS [ 788.254495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.254495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.254726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.254848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.254959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.255033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.255182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.255258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.255347] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.262981] env[68828]: INFO networking_nsxv3.common.synchronization [req-8dc81e28-40e3-48c6-a942-3f61f5f703b4 req-393cc5ef-b5bd-466f-ab22-359bf45bfbd0 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 788.263477] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 788.263621] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb85f31-5e65-47cb-bc60-aada80785442 with Priority: HIGH for action security_group_rules [ 788.263725] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGH for action security_group_rules [ 788.263823] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGH for action security_group_rules [ 788.263915] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGH for action security_group_rules [ 788.264016] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185198c9-6b76-40ca-9634-3cee48a72a6d with Priority: HIGH for action security_group_rules [ 788.264117] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGH for action security_group_rules [ 788.264206] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e219c53b-e778-4026-be0f-56af2cd314f8 with Priority: HIGH for action security_group_rules [ 788.264295] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 with Priority: HIGH for action security_group_rules [ 788.264384] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c with Priority: HIGH for action security_group_rules [ 788.264470] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGH for action security_group_rules [ 788.264556] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 with Priority: HIGH for action security_group_rules [ 788.264642] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b with Priority: HIGH for action security_group_rules [ 788.264731] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGH for action security_group_rules [ 788.264812] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e with Priority: HIGH for action security_group_rules [ 788.264895] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGH for action security_group_rules [ 788.264980] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGH for action security_group_rules [ 788.265548] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGH for action security_group_rules [ 788.265678] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29278155-2b69-484f-b19d-598dcb421e94 with Priority: HIGH for action security_group_rules [ 788.265777] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a with Priority: HIGH for action security_group_rules [ 788.265873] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGH for action security_group_rules [ 788.266159] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.266273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.266338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.266514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.266663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.266758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.266818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.266951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.267040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.267130] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.271224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb85f31-5e65-47cb-bc60-aada80785442 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271224] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb85f31-5e65-47cb-bc60-aada80785442',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.271224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271224] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.271224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271867] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.272767] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.272905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.272961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.273116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.273180] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.274258] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-185198c9-6b76-40ca-9634-3cee48a72a6d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.274371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.274426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.274568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.274643] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('185198c9-6b76-40ca-9634-3cee48a72a6d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.276707] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.276707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.276707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.276707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.276707] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.277299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e219c53b-e778-4026-be0f-56af2cd314f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.277411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.277483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.277620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.277684] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e219c53b-e778-4026-be0f-56af2cd314f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.277908] env[68828]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 788.278574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.278690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.278749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.278867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.278934] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f9b2db3-6e42-4115-b9f5-1eac57c03110',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.281890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.281890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.282045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.282100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.282173] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.283151] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.283279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.283339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.283457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.283936] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.284736] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.284914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.284984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.285142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.285212] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e5d8d96-221b-4bfb-a293-1aa1d5812bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.286023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65ecb6f4-7309-401b-a695-1d6786a18c4b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.286136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.286187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.286322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.286391] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65ecb6f4-7309-401b-a695-1d6786a18c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.287284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.287397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.289214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.289214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.289214] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.289214] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.289214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.289214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.289214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.289214] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4b3f009-4ef7-4a2c-9670-9235fef4370e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.290515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.290515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.290515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.290515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.290515] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.291403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.291403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.291403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.291403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.291403] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.292558] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.292558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.292835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.292835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.292835] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.293054] env[68828]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 788.293679] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29278155-2b69-484f-b19d-598dcb421e94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.294361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.294361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.294361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.294361] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29278155-2b69-484f-b19d-598dcb421e94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.294983] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.295125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.295187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.295331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.295396] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfa5a1fe-085f-464d-8f13-c58c1c0ee85a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.296242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.296370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.296449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.296552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.297654] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.302529] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.302740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.302740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.304073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.331555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.333658] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.333658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.333658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.333658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.333658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.333658] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 788.357743] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.357743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.357743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.357967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.358094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.366840] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 788.528469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.528469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.528469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.528469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.528469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.528469] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be updated. [ 788.540597] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.543639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.543639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.543639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.543639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.543639] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 788.552958] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.552958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.552958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.552958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.552958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.562579] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: IN_PROGRESS for 2s [ 788.570389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.570554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.570659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.570877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.571075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.579973] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 788.759204] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.789448] env[68828]: INFO networking_nsxv3.common.synchronization [req-9a624d23-f2a2-4902-83fb-0aa39e2fb0af req-f22e82fe-998a-4a1d-a553-2d92bd2054d6 tempest-ImagesOneServerTestJSON-1388923083 tempest-ImagesOneServerTestJSON-1388923083-project-member] Enqueued Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_members [ 788.790189] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGHEST for action security_group_members [ 788.790642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.790642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.790790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.790914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.791091] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.791243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.791243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.791401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.791491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.791606] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.801019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.801150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.801228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.801426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.801606] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.801707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.801771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.802465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.802465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.802465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.802465] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.820128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.820301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.820352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.820694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.833931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.834083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.834135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.834322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.834493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.834599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.834662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.834814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.834894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.834978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.835951] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.840466] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.840650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.840650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.840818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.840975] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.841084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.841139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.841285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.841366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.841443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.841588] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.845228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.845414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.845414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.848371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.848371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.848371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.848371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.848371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.848371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.848371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.848371] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.851287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.851287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.853739] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.853739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.853739] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.857036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.857036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.857036] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.857036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.857036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.857860] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.857860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.857860] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.859570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.859684] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb85f31-5e65-47cb-bc60-aada80785442 is going to be deleted. [ 788.864838] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.865038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.865038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.865381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.868710] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.868801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.872053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.872177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.872247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.872429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.872624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.872675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.872732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.873023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.873023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.873140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.873176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.873326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.873326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.873456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.873591] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.873677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.873736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.873891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.873970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.874062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.874148] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.875076] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.882908] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.883990] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.884120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.884176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.884367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.884517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.884677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.884752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.884906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.884985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.885326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.885626] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.885626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.885626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.885786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.886066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.886066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.886222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.886269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.886342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.886423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.886560] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.889515] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.889732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.889878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.890160] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.890458] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.890647] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.890880] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.891195] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.891394] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.892992] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.892992] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.892992] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.892992] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.892992] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.892992] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.892992] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.907294] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9cd372-4403-4f1e-910f-c55839944672: rpc.has_security_group_logging(os_id): False [ 788.910439] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03: rpc.has_security_group_logging(os_id): False [ 788.918463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.918609] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be deleted. [ 788.920276] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.920409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.920497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.920737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.927210] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.927210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.927584] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.927636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.930899] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.931032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.931863] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.931863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.932545] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.932663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.933553] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.933553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.942884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.943011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.944313] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.944425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.945230] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.945356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.954958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.955125] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e219c53b-e778-4026-be0f-56af2cd314f8 is going to be deleted. [ 788.956156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.956357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.959806] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.959938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.964188] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.964188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.964188] env[68828]: WARNING urllib3.connectionpool [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 788.964188] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.964188] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.070 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.964188] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.964188] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.964188] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.964188] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.964188] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.964188] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.964188] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.966510] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 788.966510] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.966510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.978604] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 788.978985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.979123] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4b3f009-4ef7-4a2c-9670-9235fef4370e is going to be deleted. [ 788.980197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.980460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.000425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.000562] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29278155-2b69-484f-b19d-598dcb421e94 is going to be deleted. [ 789.001632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.001842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.004059] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.004161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.021282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.021282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.034144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.034144] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfa5a1fe-085f-464d-8f13-c58c1c0ee85a is going to be deleted. [ 789.035048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.035272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.044758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.044876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.074512] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.074693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.097355] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 789.097750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.097944] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f9b2db3-6e42-4115-b9f5-1eac57c03110 is going to be deleted. [ 789.098894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.099115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.142609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.142746] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c is going to be deleted. [ 789.143709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.144025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.253582] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.254253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.261256] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.287056] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee881f3c-d61c-4373-931c-252d84c5ac2b in Status: SUCCESS [ 789.287056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.291612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.291612] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65ecb6f4-7309-401b-a695-1d6786a18c4b is going to be deleted. [ 789.292027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.292244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.295037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.295037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.304932] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.305082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.305153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.305354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.305513] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.305613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.305679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.305818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.305903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.305988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.306149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.306278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.306322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.306429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.306560] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.306650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.306706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.307314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.307314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.307314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.307314] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.340066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.340195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.340240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.340442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.340600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.340698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.340762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.340903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.340989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.341086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.341227] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.341315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.341374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.341558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.341708] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.341796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.341851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.341983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.342068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.342147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.342232] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.347229] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.347330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.358431] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 in Status: SUCCESS [ 789.358646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.358800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.359014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.359202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.359319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.359382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.359547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.359644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.359732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.359823] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.362660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.362768] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 185198c9-6b76-40ca-9634-3cee48a72a6d is going to be deleted. [ 789.363658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.363843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.363925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.364031] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be deleted. [ 789.364804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.364974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.372062] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.380574] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8e993f1-ee06-4325-98b9-4dc8467a2fb3: rpc.has_security_group_logging(os_id): False [ 789.381613] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d51724-5116-4cde-bbe3-36293e35d81b: rpc.has_security_group_logging(os_id): False [ 789.392748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.392748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e5d8d96-221b-4bfb-a293-1aa1d5812bf3 is going to be deleted. [ 789.393823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.394095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.415111] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.415264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.417342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.417452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.439234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.439353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.440187] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.440283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.445971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.446110] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be deleted. [ 789.446970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.447193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.467641] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.467858] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.467960] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.468261] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.468413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.468596] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 not found, creating... [ 789.468883] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.469053] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.469178] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.469407] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.469565] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.469877] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.470060] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.470186] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.470388] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.470528] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.470673] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 is going to be created. [ 789.488352] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.488500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.500711] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.501040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.506370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.506604] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.506745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.506898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.507083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.507246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.508093] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.508093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.508093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.508093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.508093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.508093] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.508093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.508738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.508738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.508738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.508738] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 is going to be updated. [ 789.509522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.509757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.522375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.522517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.530429] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.530654] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.530761] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.531063] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.531306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.532031] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.562331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.562643] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.562762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.562830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.563048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.563098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.563193] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 is going to be updated. [ 789.564287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.564541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.564541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.564663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.564810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.564969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.565068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.565182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e219c53b-e778-4026-be0f-56af2cd314f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.566028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.566028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.566028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.566028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4b3f009-4ef7-4a2c-9670-9235fef4370e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.566028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.566233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.566233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.566348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29278155-2b69-484f-b19d-598dcb421e94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.566822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.566977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.567069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.567186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfa5a1fe-085f-464d-8f13-c58c1c0ee85a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.567301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.567521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.640363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.640647] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.640795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.640840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.641136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.641235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.641333] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 is going to be updated. [ 789.642372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.642629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.642729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.642881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65ecb6f4-7309-401b-a695-1d6786a18c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.643482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.643696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.643811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.643981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70fa1cd4-fbf8-4fcf-9f64-54e3383eeb6c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.644657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.644877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.654433] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.654577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.683890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.684051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.698134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.698423] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.698611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.698683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.698877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.698962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.699277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.699431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.699542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.699663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.699738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.699916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.699997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.702516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.702691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.702777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.702876] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be updated. [ 789.703992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.704169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.705717] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.705831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.705900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.706068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.706265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.764624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.764875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.764995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.765333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.765481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.765639] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 is going to be updated. [ 789.768139] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 in Status: IN_PROGRESS for 2s [ 789.788481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.788788] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.788896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.788964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.789213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.789315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.789392] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 is going to be updated. [ 789.791461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.791461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.791461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.791461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.791461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.791461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.791853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.791853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb85f31-5e65-47cb-bc60-aada80785442" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.791853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e5d8d96-221b-4bfb-a293-1aa1d5812bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.792707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f9b2db3-6e42-4115-b9f5-1eac57c03110" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.793413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.793413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.793413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.793610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.793681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.793826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.793974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.795786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.795786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.795786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.795786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-185198c9-6b76-40ca-9634-3cee48a72a6d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.803166] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.803166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.803166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.803288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.804050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.808862] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f82e204-74c2-4f16-ab6e-65554153de56: rpc.has_security_group_logging(os_id): False [ 789.845296] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa: rpc.has_security_group_logging(os_id): False [ 789.862908] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.863320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.863320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.863462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.863692] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.863692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.863692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.863864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.863950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.864064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.864221] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.864320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.864369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.864504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.864652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.864721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.864773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.864979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.864979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.865062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.865148] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.875164] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61fe50ff-0f58-47fa-9ef5-7eec076d9a64: rpc.has_security_group_logging(os_id): False [ 789.890627] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: IN_PROGRESS for 2s [ 789.892017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.892164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.892226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.892419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.897342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.897342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.910175] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: IN_PROGRESS for 2s [ 789.920346] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.920514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.944287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.944650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.944831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.945200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.945571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.954422] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.954560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.957648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.957921] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.958058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.958126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.958323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.958404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.958596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.958695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.958757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.958905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.958981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.959177] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.959255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.959315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.959464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.959545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.959632] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be updated. [ 789.960902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.961079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.976222] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: IN_PROGRESS for 2s [ 789.988168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.988298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.004553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.004894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.005039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.005039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.005249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.005335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.005527] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.005649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.005699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.005816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.005887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.006358] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.006358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.006358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.006358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.006521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.006521] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be updated. [ 790.007981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.007981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.008132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.008881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.009051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.019868] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: IN_PROGRESS for 2s [ 790.054127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.054448] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.054575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.054633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.055452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.055452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.055452] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be updated. [ 790.057122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.057313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.057455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.074619] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.074767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.074824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.074986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.075143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.077118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 790.113585] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 790.176823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.177066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.177066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.177292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.177495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.182165] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.182284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.182345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.182532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.182706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.194924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 790.196840] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.197243] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: IN_PROGRESS for 2s [ 790.367863] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72dfb289-4716-4f30-92e1-ad6fe6010326: rpc.has_security_group_logging(os_id): False [ 790.387131] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.387311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.387383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.387545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.387630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.387849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.387945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.388014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.388166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.388238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.388408] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.389018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.389018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.389018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.389018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.389018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.389252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.389252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.389310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.389356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.389437] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 is going to be created. [ 790.391254] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 790.391412] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 790.391518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.448420] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.448665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.448665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.448883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.449073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.458759] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 in Status: IN_PROGRESS for 2s [ 790.575569] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 790.575806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.576072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.576293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.576489] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.576603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.576671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.576815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.576896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.576979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.577092] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.577920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.578246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.578414] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.578520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.578577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.578720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.578798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.578916] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.589847] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 790.591209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.591209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.591209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.591209] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.591209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.591209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.591575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.591575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.591575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.591575] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.592852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.593522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.593727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.593964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.594031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.594148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.594232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.594324] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.605763] env[68828]: INFO networking_nsxv3.common.synchronization [req-8dc81e28-40e3-48c6-a942-3f61f5f703b4 req-359844fc-20ff-450a-b339-1939628d8af1 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 790.605937] env[68828]: INFO networking_nsxv3.common.synchronization [req-8dc81e28-40e3-48c6-a942-3f61f5f703b4 req-359844fc-20ff-450a-b339-1939628d8af1 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 790.606091] env[68828]: INFO networking_nsxv3.common.synchronization [req-8dc81e28-40e3-48c6-a942-3f61f5f703b4 req-359844fc-20ff-450a-b339-1939628d8af1 service nova] Enqueued Resource ID: 9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 with Priority: HIGHEST for action port [ 790.606541] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 790.606675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 790.606772] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 with Priority: HIGHEST for action port [ 790.608163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.608901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.608984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.609206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.609327] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.612354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.612544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.612827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.613090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.613296] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.613437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.613520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.613741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.613779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.613868] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.618439] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.618439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.618439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.618439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.618658] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.886637] env[68828]: INFO networking_nsxv3.common.synchronization [req-dce7bb0e-a3fe-42f3-aa48-9edf749807d2 req-5f20b157-efe8-4413-b557-ab2bad38e5cd tempest-ServersTestBootFromVolume-617483818 tempest-ServersTestBootFromVolume-617483818-project-member] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_members [ 790.888840] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_members [ 790.889217] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.889343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.889407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.889758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.889934] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.890051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.890112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.890272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.890354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.890454] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.081135] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.082109] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.095865] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.096834] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.096941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.120170] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.120317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.121673] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.122641] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 with status ACTIVE [ 791.122851] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.123138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.123138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.123405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.123502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.123682] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.124026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.124026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.124026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.124147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.124271] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.124364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.124607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.124607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.124723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.124723] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65 is going to be updated. [ 791.146294] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.146467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.146524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.146727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.146865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.147038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2ef51b-6fc6-40a4-bfad-dd9e0ec70e65" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.312817] env[68828]: INFO networking_nsxv3.common.synchronization [req-dbd712ba-58b7-43b2-8fd6-f45fdbc45885 req-813825c1-99a0-4ec8-8dd5-d02fb8e32c1d tempest-ServerPasswordTestJSON-1596041620 tempest-ServerPasswordTestJSON-1596041620-project-member] Enqueued Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_members [ 791.313073] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGHEST for action security_group_members [ 791.313317] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.313491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.313560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.314037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.314037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.314037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.318097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.318335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.318436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.318559] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.393592] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.394149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.394149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.394149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.394149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.394375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.394496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.394554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.394660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.394737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.394818] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 already deleted. [ 791.394898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.476244] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-619 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.476447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-619" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.476576] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-619" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.476946] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-619" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.477185] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.477346] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.477473] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.478167] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.478348] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.478853] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.478985] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.479118] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.479238] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.479359] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.479473] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.479622] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.522638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.522868] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.523022] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.523209] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-619" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.523533] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-2692b868-5327-4120-92dc-1b99cef82c14 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.523713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.523839] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.524190] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.524334] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2692b868-5327-4120-92dc-1b99cef82c14',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.584216] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.590168] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec: rpc.has_security_group_logging(os_id): False [ 791.598313] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.605570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.606356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.606545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.610782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.610782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.610782] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.610782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.610782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.610782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.611104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.611104] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be created. [ 791.627589] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.672902] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.673128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.673238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.673530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.673778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.684631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: IN_PROGRESS for 2s [ 791.783801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 in Status: SUCCESS [ 791.784108] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 deletion is rescheduled due to dependency. [ 791.784255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.821256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.821256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.821256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.821530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.821530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.822200] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.822200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.822200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.822200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.822200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.822200] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 is going to be updated. [ 791.850890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.851070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.851117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.851321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.851473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.859179] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: IN_PROGRESS for 2s [ 791.903810] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: SUCCESS [ 791.904078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.920192] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: SUCCESS [ 791.920417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.984768] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: SUCCESS [ 791.984862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.984951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.985413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.985762] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.985886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.985964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.986128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.986211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.986290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.986383] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.026765] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.027012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.027158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.027447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.027598] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.027803] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 2692b868-5327-4120-92dc-1b99cef82c14 not found, creating... [ 792.028087] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.028252] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.028375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.028598] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.028741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.029035] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.029199] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.029332] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.029723] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.029878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.030276] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 2692b868-5327-4120-92dc-1b99cef82c14 is going to be created. [ 792.032086] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: SUCCESS [ 792.032275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.046765] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.047026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.047150] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.047423] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.047730] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.047871] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.089104] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 792.089334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.089750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.089888] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.089951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.090171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.090246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.090402] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be updated. [ 792.101065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.101218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.101218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.101404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.101487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.101600] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 792.123764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.123902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.123976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.124198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.124338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.129966] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.130106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.130106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.130277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.130361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.130452] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 792.134998] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: IN_PROGRESS for 2s [ 792.155848] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 792.155848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.164061] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.164061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.164061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.164061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.164061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.172904] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 792.195478] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.195668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.195769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.195994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.196207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.208383] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 792.212373] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 792.212629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.213399] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 792.213599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.472384] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 in Status: SUCCESS [ 792.472769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.489297] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.728434] env[68828]: INFO networking_nsxv3.common.synchronization [req-dce7bb0e-a3fe-42f3-aa48-9edf749807d2 req-4910c64f-0f2f-4a02-9dfb-92fc324761f7 service nova] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_rules [ 792.728434] env[68828]: INFO networking_nsxv3.common.synchronization [req-dce7bb0e-a3fe-42f3-aa48-9edf749807d2 req-4910c64f-0f2f-4a02-9dfb-92fc324761f7 service nova] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_members [ 792.728434] env[68828]: INFO networking_nsxv3.common.synchronization [req-dce7bb0e-a3fe-42f3-aa48-9edf749807d2 req-4910c64f-0f2f-4a02-9dfb-92fc324761f7 service nova] Enqueued Resource ID: 2692b868-5327-4120-92dc-1b99cef82c14 with Priority: HIGHEST for action port [ 792.728794] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_rules [ 792.728794] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_members [ 792.728794] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2692b868-5327-4120-92dc-1b99cef82c14 with Priority: HIGHEST for action port [ 792.729959] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.730122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.730191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.730401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.730529] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.731356] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.731465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.731563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.731742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.731893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.731997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.732067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.732206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.732285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.732375] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.733157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2692b868-5327-4120-92dc-1b99cef82c14 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.733260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.733324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.733469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.733732] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2692b868-5327-4120-92dc-1b99cef82c14',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.992560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3f83419-8dd4-4326-ad0d-7a38e73a74f4: rpc.has_security_group_logging(os_id): False [ 793.009747] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.009895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.009965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.010656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.010706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.010960] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.011092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.011140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.011303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.011409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.011773] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 is going to be created. [ 793.059768] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.059917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.059981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.060249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.060427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.071712] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: IN_PROGRESS for 2s [ 793.235815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.235973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.236160] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.237089] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2692b868-5327-4120-92dc-1b99cef82c14 with status ACTIVE [ 793.237304] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.237439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.237439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.237647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.237723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.237891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.237988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.238059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.238205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.238284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.238453] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.238552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.238625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.238772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.238847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.238941] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2692b868-5327-4120-92dc-1b99cef82c14 is going to be updated. [ 793.262354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.262619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.262619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.262851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.262986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.263158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2692b868-5327-4120-92dc-1b99cef82c14" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.695824] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 793.696218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.696280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.696482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.696571] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.741464] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.869894] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9cd372-4403-4f1e-910f-c55839944672 in Status: SUCCESS [ 793.870073] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 deletion is rescheduled due to dependency. [ 793.870187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.143734] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 794.144077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.144240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.144447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.144630] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.144746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.144808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.144947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.145034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.145124] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.179560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 794.179778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.179932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.180187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.180370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.180485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.180555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.180707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.180823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.180924] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.200182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.200370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.216526] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 794.216649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.216706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.217080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.217269] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.217452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.220066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.220066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.220066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.220066] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.243742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.243936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.244018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.244180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.244264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.244357] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 is going to be created. [ 794.265480] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.265674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.265755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.266062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.266305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.286210] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d08e462e-e8d3-4628-bfb2-6725e011db83 in Status: UNINITIALIZED for 2s [ 794.648058] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.685543] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.721748] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.722162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.722716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.722994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.723206] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.723318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.723375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.723616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.723616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.723758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.723886] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.724017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.724055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.724193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.724329] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.724586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.724586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.724736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.724736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.725732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.725732] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.801492] env[68828]: INFO networking_nsxv3.common.synchronization [req-bc2b0a21-cda8-499f-8e4a-dfa2d9c96e5f req-3e0ac1bf-50b2-4fe9-bfdf-8421de85122e tempest-ServerDiagnosticsTest-2092774002 tempest-ServerDiagnosticsTest-2092774002-project-member] Enqueued Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_members [ 794.802169] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGHEST for action security_group_members [ 794.802493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.805209] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.805209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.805209] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.084663] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: SUCCESS [ 795.085085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.150665] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.190268] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.227779] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fdb4832-fb6b-46dc-9929-5e545ccfc219: rpc.has_security_group_logging(os_id): False [ 795.259087] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.259087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.259246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.259424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.259512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.259792] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.259947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.259947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.260133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.260207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.260510] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.260510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.260510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.260778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.260778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.260924] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.261040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.261040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.261163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.261213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.261296] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be created. [ 795.307884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.307884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.307884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.308226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.319266] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.319405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.327718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.327972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.328128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.328193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.328379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.328465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.328559] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee881f3c-d61c-4373-931c-252d84c5ac2b is going to be updated. [ 795.329638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.329807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.329982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.344125] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 795.353802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.354056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.354172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.354394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.354537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.361618] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee881f3c-d61c-4373-931c-252d84c5ac2b in Status: IN_PROGRESS for 2s [ 795.652987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.653203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.653290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.653444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.653538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.653660] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be updated. [ 795.686680] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.686844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.686910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.687168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.687316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.696385] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.696674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.696674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.697117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.697117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.697117] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 795.698960] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: IN_PROGRESS for 2s [ 795.739435] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.739781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.739781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.739899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.740044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.752398] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 796.299330] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d08e462e-e8d3-4628-bfb2-6725e011db83 in Status: SUCCESS [ 796.299584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.299772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.300017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.300240] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.300377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.300444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.300611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.300707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.300806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.300908] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.805547] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.307875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d08e462e-e8d3-4628-bfb2-6725e011db83: rpc.has_security_group_logging(os_id): False [ 797.325663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.325826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.325936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.326192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.326275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.326548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.326655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.326725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.326867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.326951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.327031] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 is going to be created. [ 797.358155] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 797.358382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.373331] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee881f3c-d61c-4373-931c-252d84c5ac2b in Status: SUCCESS [ 797.374228] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee881f3c-d61c-4373-931c-252d84c5ac2b deletion is rescheduled due to dependency. [ 797.375472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.393534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.393690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.393804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.394300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.394300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.404256] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d08e462e-e8d3-4628-bfb2-6725e011db83 in Status: IN_PROGRESS for 2s [ 797.714154] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 797.714839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.714839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.714839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.714991] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.715070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.715641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.715641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.715641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.715641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.715641] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.763594] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.763594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.763594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.763594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.764481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.765328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.765328] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.765328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.765580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.765831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.766473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.766473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.766473] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.218423] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.268650] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9050286-eb81-4cbb-9bd8-733baee0e20c: rpc.has_security_group_logging(os_id): False [ 798.288174] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.288174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.288174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.288174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.305464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.305793] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.305991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.306092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.306358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.306456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.306758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.306921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.307385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.308503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.308503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.308503] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.308503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.308503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.308503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.308503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.308968] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 798.326774] env[68828]: INFO networking_nsxv3.common.synchronization [req-751824b0-2007-4d1c-8e6e-33ed9dd3a291 req-9bf00c0c-688a-46f7-bc91-5e0ea0525853 tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 798.329088] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 798.329088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.329088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.329318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.329817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.329995] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.330113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.330173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.330337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.330419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.330547] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.365997] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.365997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.365997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.365997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.365997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.376818] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 798.724210] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec: rpc.has_security_group_logging(os_id): False [ 798.742063] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.742063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.742063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.742063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.742063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.742616] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.742870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.743041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.743282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.743969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.743969] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be updated. [ 798.809805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.810177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.810758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.810758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.811970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.823092] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: IN_PROGRESS for 2s [ 798.833792] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.834034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.834135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.834405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.834526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.834804] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.834989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.835111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.835327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.835442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.835525] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 already deleted. [ 798.835586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.132499] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.132759] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.132864] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.133201] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.133485] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.134299] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.134439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.134676] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.134831] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.135103] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.135626] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.137936] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.138118] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.138256] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.138379] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.138527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.157611] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.157781] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.157930] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.158129] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.158568] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.158714] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.158714] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.159066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.159258] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.415844] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d08e462e-e8d3-4628-bfb2-6725e011db83 in Status: SUCCESS [ 799.416195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.662247] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.662486] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.662617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.662971] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.663153] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.663314] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 not found, creating... [ 799.663576] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.663739] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.663860] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.664105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.664248] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.664525] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.664689] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.664813] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.665035] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.665177] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.665321] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 is going to be created. [ 799.685597] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.685804] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.685931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.686208] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.686435] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.686712] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.398426] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 800.398661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.398840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.399070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.399162] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.421626] env[68828]: INFO networking_nsxv3.common.synchronization [req-751824b0-2007-4d1c-8e6e-33ed9dd3a291 req-5b8a71bd-31b2-4563-bdcd-7796cf2f8842 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 800.421626] env[68828]: INFO networking_nsxv3.common.synchronization [req-751824b0-2007-4d1c-8e6e-33ed9dd3a291 req-5b8a71bd-31b2-4563-bdcd-7796cf2f8842 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 800.421626] env[68828]: INFO networking_nsxv3.common.synchronization [req-751824b0-2007-4d1c-8e6e-33ed9dd3a291 req-5b8a71bd-31b2-4563-bdcd-7796cf2f8842 service nova] Enqueued Resource ID: ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 with Priority: HIGHEST for action port [ 800.421626] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 800.421626] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 800.421626] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 with Priority: HIGHEST for action port [ 800.422193] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.423971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.424091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.424345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.424428] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.429022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.429022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.429022] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.429022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.429022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.429022] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.837487] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 800.838552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.905156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.905156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.905156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.905156] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.931453] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.931727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.932030] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 with status ACTIVE [ 800.932263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.932338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.932492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.932634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.932765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.932930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.933046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.933105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.933271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.933350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.933588] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.933675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.933722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.933828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.933941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.934049] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0 is going to be updated. [ 800.935515] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.949229] env[68828]: INFO networking_nsxv3.common.synchronization [req-f21d310d-e2e4-4051-aaf2-787510f01e3f req-284aac52-83c4-4568-b87a-a170136627fe tempest-ServerRescueTestJSON-1908369248 tempest-ServerRescueTestJSON-1908369248-project-member] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 800.950500] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 800.950848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.951089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.951089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.951286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.952326] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.952326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.952326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.952326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.952326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.952326] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.957150] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.957335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.957383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.957535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.957778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.957910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec7261ab-5ab3-4e57-9ec4-13a0cd697ef0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.337099] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.337099] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.337099] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.338039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.338039] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.338039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.338039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.339679] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.339925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.340203] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.340386] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.340544] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.340681] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.340820] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.340953] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.341198] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.363191] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.363191] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.363191] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.363191] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.363191] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c975217a-1497-453d-a489-ed2c31f97d2a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.363191] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.363191] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.363191] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.363191] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975217a-1497-453d-a489-ed2c31f97d2a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.407157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.407932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.411138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.411138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.411138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.411138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.412189] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.439667] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.455687] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.805286] env[68828]: INFO networking_nsxv3.common.synchronization [req-3f0dd5c1-2c0a-4f00-b753-7729bbd86b8d req-8dda9f07-37cb-4a99-9c59-b6b4fe427c3d tempest-VolumesAdminNegativeTest-51626435 tempest-VolumesAdminNegativeTest-51626435-project-member] Enqueued Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_members [ 801.805286] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGHEST for action security_group_members [ 801.805286] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.805286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.805286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.805286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.805286] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.805286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.805881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.806181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.806390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.806591] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.866499] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.866645] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.866781] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.867111] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.867275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.867435] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c975217a-1497-453d-a489-ed2c31f97d2a not found, creating... [ 801.867706] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.867913] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.867988] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.868228] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.868616] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.868918] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.869098] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.869225] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.869451] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.869623] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.869776] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c975217a-1497-453d-a489-ed2c31f97d2a is going to be created. [ 801.890071] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.890319] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.891503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.891503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.891503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.891503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.916377] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9050286-eb81-4cbb-9bd8-733baee0e20c: rpc.has_security_group_logging(os_id): False [ 801.934649] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.934649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.935674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.935674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.935674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.935674] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.936053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.936053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.936053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.936222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.936405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.936405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.936555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.936603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.936692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.937020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.937020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.937210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.937210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.937307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.937339] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 801.944981] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.945130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.945202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.945371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.945455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.945548] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be created. [ 801.957635] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.964382] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.964517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.964624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.964773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.964923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.977180] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: UNINITIALIZED for 2s [ 802.009903] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.010078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.010222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.010541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.010741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.036862] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 802.308705] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.311517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.311517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.311517] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 is going to be updated. [ 802.336644] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.336775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.336850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.337073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.337210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.346145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 in Status: IN_PROGRESS for 2s [ 802.466913] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.466913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.466913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.466913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.466913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.466913] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be updated. [ 802.490233] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.490233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.490233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.490233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.490233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.501309] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 802.845949] env[68828]: INFO networking_nsxv3.common.synchronization [req-f21d310d-e2e4-4051-aaf2-787510f01e3f req-c465255d-bda9-4254-86f0-8984d33e80f8 service nova] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_rules [ 802.846691] env[68828]: INFO networking_nsxv3.common.synchronization [req-f21d310d-e2e4-4051-aaf2-787510f01e3f req-c465255d-bda9-4254-86f0-8984d33e80f8 service nova] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 802.846904] env[68828]: INFO networking_nsxv3.common.synchronization [req-f21d310d-e2e4-4051-aaf2-787510f01e3f req-c465255d-bda9-4254-86f0-8984d33e80f8 service nova] Enqueued Resource ID: c975217a-1497-453d-a489-ed2c31f97d2a with Priority: HIGHEST for action port [ 802.847408] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_rules [ 802.848068] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 802.848328] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c975217a-1497-453d-a489-ed2c31f97d2a with Priority: HIGHEST for action port [ 802.849360] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.849621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.849672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.849906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.850019] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.853264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.853264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.853264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c975217a-1497-453d-a489-ed2c31f97d2a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.853264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.853264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.853264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.853264] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975217a-1497-453d-a489-ed2c31f97d2a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.354342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.355232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.355473] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c975217a-1497-453d-a489-ed2c31f97d2a with status ACTIVE [ 803.355692] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.355852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.355922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.356154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.356241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.356405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.356496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.356554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.356698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.357303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.357303] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.357303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.357303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.357303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.357303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.357540] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c975217a-1497-453d-a489-ed2c31f97d2a is going to be updated. [ 803.378472] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.378828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.378970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.379427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.379427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.379653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c975217a-1497-453d-a489-ed2c31f97d2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.612091] env[68828]: INFO networking_nsxv3.common.synchronization [None req-202fa7c9-031c-456a-b1f1-eed2d604695b None None] Enqueued Resource ID: 530d8d28-6a78-482f-bea8-77c751a73b59 with Priority: HIGHEST for action port [ 803.612663] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d8d28-6a78-482f-bea8-77c751a73b59 with Priority: HIGHEST for action port [ 803.613010] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-530d8d28-6a78-482f-bea8-77c751a73b59 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.616754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-530d8d28-6a78-482f-bea8-77c751a73b59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.616754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-530d8d28-6a78-482f-bea8-77c751a73b59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.616754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-530d8d28-6a78-482f-bea8-77c751a73b59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.616754] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('530d8d28-6a78-482f-bea8-77c751a73b59',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.990513] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 803.990513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.990513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.990513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.990513] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.990945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.990945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.990945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.990945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.991133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.991133] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.052100] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 804.052100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.120568] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 530d8d28-6a78-482f-bea8-77c751a73b59 [ 804.120812] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.120948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.121037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.121252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.121309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.121408] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:530d8d28-6a78-482f-bea8-77c751a73b59 already deleted. [ 804.121489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-530d8d28-6a78-482f-bea8-77c751a73b59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.357495] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 in Status: SUCCESS [ 804.357629] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 deletion is rescheduled due to dependency. [ 804.357674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.499265] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.499437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.499523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.499787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.499976] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.500360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.500360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.500360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.500458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.500458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.500605] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.500696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.500759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.500991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.501151] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.501243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.501303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.501441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.501516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.501594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.501742] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.510505] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 804.510732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.510887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.511204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.511481] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.511670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.511817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.512054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.512195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.512349] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.009515] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 805.014574] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.028595] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.028742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.029265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.029493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.029621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.029844] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.029955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.030034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.030196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.030274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.031121] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.031121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.031121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.031121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.031758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.031758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.031758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.031758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.031758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.031758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.031758] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be created. [ 805.086465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.086625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.086694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.086960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.087175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.098275] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 805.520017] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.769203] env[68828]: INFO networking_nsxv3.common.synchronization [None req-f78659a4-391e-4389-aeab-dcd81f52cd42 None None] Enqueued Resource ID: a7b9d1bb-5d2e-4f65-a60d-e9b881df53de with Priority: HIGHEST for action port [ 805.770032] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b9d1bb-5d2e-4f65-a60d-e9b881df53de with Priority: HIGHEST for action port [ 805.770032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7b9d1bb-5d2e-4f65-a60d-e9b881df53de taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.770231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7b9d1bb-5d2e-4f65-a60d-e9b881df53de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.770231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7b9d1bb-5d2e-4f65-a60d-e9b881df53de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.770475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7b9d1bb-5d2e-4f65-a60d-e9b881df53de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.770551] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7b9d1bb-5d2e-4f65-a60d-e9b881df53de',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.027882] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.027882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.027882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.027882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.027882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.027882] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be updated. [ 806.055451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.055579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.055727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.056744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.056744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.068286] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 806.274263] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7b9d1bb-5d2e-4f65-a60d-e9b881df53de [ 806.274263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.274263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.274263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.274263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.274263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.274263] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7b9d1bb-5d2e-4f65-a60d-e9b881df53de already deleted. [ 806.274603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7b9d1bb-5d2e-4f65-a60d-e9b881df53de" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.276244] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2b93c2d-5282-4229-b091-06333b69ee4a req-215aa2e1-c8be-4ff9-a7d4-61ad901a1c16 tempest-ServersAdminNegativeTestJSON-1903577502 tempest-ServersAdminNegativeTestJSON-1903577502-project-member] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 806.276244] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 806.276444] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.276568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.276650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.276863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.277025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.277136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.277176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.277380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.277465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.277559] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.781338] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.807160] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.807380] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.807508] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.807784] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.808214] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.808398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.808605] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.808757] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.808902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.809419] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.809586] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.809735] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.809861] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.809984] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.810111] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.810253] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.829704] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.830042] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.830284] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.830649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.831218] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5da9177d-5425-4c78-a704-3b38ac0d7867 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.831852] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.831852] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.832387] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.832708] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da9177d-5425-4c78-a704-3b38ac0d7867',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.109687] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 807.110653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.283422] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.335553] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.335795] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.336171] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.336261] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.336399] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.336556] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5da9177d-5425-4c78-a704-3b38ac0d7867 not found, creating... [ 807.336825] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.337064] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.337111] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.337337] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.338023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.338023] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.338023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.338226] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.338606] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.338606] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.338606] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5da9177d-5425-4c78-a704-3b38ac0d7867 is going to be created. [ 807.376094] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.376360] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.376480] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.376773] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.377021] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.377256] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.786034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.786225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.786316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.786511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.786602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.786697] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be updated. [ 807.815251] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.815380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.815445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.815648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.815782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.824953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 808.079447] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.079447] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.079447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.079447] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.451669] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2b93c2d-5282-4229-b091-06333b69ee4a req-e51ed227-b8ba-4c4f-9a6f-a7f2f80b75f1 service nova] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_rules [ 808.451976] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2b93c2d-5282-4229-b091-06333b69ee4a req-e51ed227-b8ba-4c4f-9a6f-a7f2f80b75f1 service nova] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 808.451976] env[68828]: INFO networking_nsxv3.common.synchronization [req-a2b93c2d-5282-4229-b091-06333b69ee4a req-e51ed227-b8ba-4c4f-9a6f-a7f2f80b75f1 service nova] Enqueued Resource ID: 5da9177d-5425-4c78-a704-3b38ac0d7867 with Priority: HIGHEST for action port [ 808.452625] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_rules [ 808.452789] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 808.452911] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da9177d-5425-4c78-a704-3b38ac0d7867 with Priority: HIGHEST for action port [ 808.457415] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.457560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.457621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.457822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.457934] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.458861] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.458946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.459126] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5da9177d-5425-4c78-a704-3b38ac0d7867 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.459240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.463085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.463085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.463085] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da9177d-5425-4c78-a704-3b38ac0d7867',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.584544] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.584633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.584633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.584870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.585065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.585170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.585237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.585391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.585478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.585569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.585715] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.585810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.585870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.586035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.586202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.586369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.586369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.586492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.586622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.586798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.586798] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.961883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.961883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.968055] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5da9177d-5425-4c78-a704-3b38ac0d7867 with status ACTIVE [ 808.968268] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.968331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.968387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.968877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.968999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.969205] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.969309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.969373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.969544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.969672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.969822] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.969915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.969973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.970128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.970204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.970291] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5da9177d-5425-4c78-a704-3b38ac0d7867 is going to be updated. [ 808.990628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.991168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.991246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.991469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.991619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.992598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5da9177d-5425-4c78-a704-3b38ac0d7867" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.089412] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d51724-5116-4cde-bbe3-36293e35d81b: rpc.has_security_group_logging(os_id): False [ 809.114549] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.114724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.114792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.114980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.115087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.115305] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.115408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.115464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.115615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.115694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.115868] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.115961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.116031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.116170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.116244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.116420] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.116545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.116581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.116696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.116770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.116855] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be updated. [ 809.194861] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.195023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.195069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.195291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.196023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.210033] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 809.834269] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 809.834671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.834671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.834855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.835054] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.835171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.835238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.835387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.835471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.835565] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.338764] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.845649] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.225408] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 811.225648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.348388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.348600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.348686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.348906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.349013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.349145] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be updated. [ 811.377645] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.377919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.378071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.378435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.378673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.387695] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 813.397990] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 813.398309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.398670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.398964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.399356] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.400502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.400647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.400879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.400975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.401085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.401187] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.453790] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 813.453893] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 813.904184] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.904346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.904413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.904630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.904802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.904892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.904956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.905119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.905196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.905286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.905430] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.905513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.905571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.905707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.906124] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.906308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.906559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.906773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.907032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.907140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.907232] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.411227] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f82e204-74c2-4f16-ab6e-65554153de56: rpc.has_security_group_logging(os_id): False [ 814.428128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.428325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.428325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.428549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.428641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.428835] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.428965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.429169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.429350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.429462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.429693] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.429795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.429855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.429997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.430083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.430273] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.430367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.430428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.430565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.430639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.430750] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be updated. [ 814.485461] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.485619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.485681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.485871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.487025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.502980] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 816.521254] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 816.521508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.454578] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 818.454892] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 821.498139] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d06c7900-75a1-4f19-addf-cae73fa2327e None None] Enqueued Resource ID: dfb75a8f-3d98-440a-b728-ac54bdaa766e with Priority: HIGHEST for action port [ 821.498756] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb75a8f-3d98-440a-b728-ac54bdaa766e with Priority: HIGHEST for action port [ 821.498974] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb75a8f-3d98-440a-b728-ac54bdaa766e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.499081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb75a8f-3d98-440a-b728-ac54bdaa766e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.499119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb75a8f-3d98-440a-b728-ac54bdaa766e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.502286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb75a8f-3d98-440a-b728-ac54bdaa766e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.502286] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb75a8f-3d98-440a-b728-ac54bdaa766e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.001402] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfb75a8f-3d98-440a-b728-ac54bdaa766e [ 822.001654] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.001823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.001891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.002122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.002212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.002309] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfb75a8f-3d98-440a-b728-ac54bdaa766e already deleted. [ 822.002389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb75a8f-3d98-440a-b728-ac54bdaa766e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.293418] env[68828]: INFO networking_nsxv3.common.synchronization [req-148ab4ab-4e02-4db9-8e97-bc96394cc657 req-2b74003e-7d05-4277-8146-76ddd60ef3f2 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 822.293418] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 822.293585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.293585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.293678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.293852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.294011] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.294547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.294612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.294800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.294868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.294960] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.798045] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.798352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.798455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.798688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.798774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.798986] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.799102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.799159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.799310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.799388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.799477] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 822.826800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.826948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.827039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.827243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.827385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.836060] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 823.933390] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a60ca77d-1e3e-4ab6-a4da-3a7de4aeae8e None None] Enqueued Resource ID: ce569206-ed0a-42df-a647-9a5a0cd027dc with Priority: HIGHEST for action port [ 823.933792] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce569206-ed0a-42df-a647-9a5a0cd027dc with Priority: HIGHEST for action port [ 823.934486] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce569206-ed0a-42df-a647-9a5a0cd027dc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.934486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce569206-ed0a-42df-a647-9a5a0cd027dc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.934486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce569206-ed0a-42df-a647-9a5a0cd027dc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.936320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce569206-ed0a-42df-a647-9a5a0cd027dc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.936320] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce569206-ed0a-42df-a647-9a5a0cd027dc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.438392] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce569206-ed0a-42df-a647-9a5a0cd027dc [ 824.438665] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.438769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.438883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.439106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.439171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.439268] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce569206-ed0a-42df-a647-9a5a0cd027dc already deleted. [ 824.439348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce569206-ed0a-42df-a647-9a5a0cd027dc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.846430] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 824.846823] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 824.846823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.317628] env[68828]: INFO networking_nsxv3.common.synchronization [req-f748025f-48c0-4607-9400-d5e78eb9f454 req-da56671c-1d74-40e7-99ae-a020a1a3f743 tempest-ServersAdminNegativeTestJSON-1903577502 tempest-ServersAdminNegativeTestJSON-1903577502-project-member] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 825.318944] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 825.318944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.318944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.318944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.318944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.319856] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.319856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.319856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.319856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.320228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.320228] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.822997] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.325408] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.828379] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.828475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.829128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.829128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.829128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.829128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be updated. [ 826.854905] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.855079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.855165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.855395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.855550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.864886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 826.894074] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d20aa411-993f-4930-a643-711232dbec02 None None] Enqueued Resource ID: cc1b1e09-04da-41b4-9efb-5f102a8b55a6 with Priority: HIGHEST for action port [ 826.894338] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1b1e09-04da-41b4-9efb-5f102a8b55a6 with Priority: HIGHEST for action port [ 826.894935] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc1b1e09-04da-41b4-9efb-5f102a8b55a6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.895149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc1b1e09-04da-41b4-9efb-5f102a8b55a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.895149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc1b1e09-04da-41b4-9efb-5f102a8b55a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.895431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc1b1e09-04da-41b4-9efb-5f102a8b55a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.901237] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc1b1e09-04da-41b4-9efb-5f102a8b55a6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.404402] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc1b1e09-04da-41b4-9efb-5f102a8b55a6 [ 827.404728] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.404823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.404823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.405833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.405833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.405833] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc1b1e09-04da-41b4-9efb-5f102a8b55a6 already deleted. [ 827.405833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc1b1e09-04da-41b4-9efb-5f102a8b55a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.875706] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 828.875706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.156770] env[68828]: INFO networking_nsxv3.common.synchronization [None req-4d9afe06-65cb-486b-ae0d-67283af4f143 None None] Enqueued Resource ID: b639d87d-8e91-4231-84a4-db4894e4cfd5 with Priority: HIGHEST for action port [ 829.157051] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b639d87d-8e91-4231-84a4-db4894e4cfd5 with Priority: HIGHEST for action port [ 829.157635] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b639d87d-8e91-4231-84a4-db4894e4cfd5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.157751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b639d87d-8e91-4231-84a4-db4894e4cfd5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.157821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b639d87d-8e91-4231-84a4-db4894e4cfd5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.158079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b639d87d-8e91-4231-84a4-db4894e4cfd5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.158208] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b639d87d-8e91-4231-84a4-db4894e4cfd5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.256217] env[68828]: INFO networking_nsxv3.common.synchronization [req-8c2d6877-e2b1-4e5e-b0bc-d5539fcfb0d7 req-7b7336bb-a89f-4cca-bf76-251de15de638 tempest-ServerRescueTestJSON-1908369248 tempest-ServerRescueTestJSON-1908369248-project-member] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 829.256965] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 829.257314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.257433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.257504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.257751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.257901] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.257995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.258074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.258208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.258289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.258474] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.660221] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b639d87d-8e91-4231-84a4-db4894e4cfd5 [ 829.660451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.660589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.660650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.660857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.660948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.661057] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b639d87d-8e91-4231-84a4-db4894e4cfd5 already deleted. [ 829.661141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b639d87d-8e91-4231-84a4-db4894e4cfd5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.762236] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.276308] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.775027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.775027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.775027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.775027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.775027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.775027] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be updated. [ 830.830135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.830983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.830983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.830983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.830983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.839738] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 831.628847] env[68828]: INFO networking_nsxv3.common.synchronization [req-11ba44b6-c37f-45d5-b14e-25d97237ba84 req-68f52bcb-f76b-4a51-8a43-972b9eea808b tempest-ServersWithSpecificFlavorTestJSON-1891684402 tempest-ServersWithSpecificFlavorTestJSON-1891684402-project-member] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 831.628847] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 831.628847] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.628847] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.628847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.628847] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.940129] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.940381] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.940533] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.940839] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.941392] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.941580] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.941721] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.942781] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.943029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.943218] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.943369] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.943480] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.944611] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.944823] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.944977] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.945142] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.962500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.962721] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.962805] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.963014] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-505" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.963338] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-cb0da3d5-42de-4963-af1e-d5e418586216 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.963513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.963633] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.963982] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.964171] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb0da3d5-42de-4963-af1e-d5e418586216',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.131548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.131718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.131878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.132141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.132291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.132441] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.132538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.132624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.132786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.132835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.132929] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be deleted. [ 832.163519] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.163658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.163731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.163937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.164040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.164142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.469457] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.469457] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port cb0da3d5-42de-4963-af1e-d5e418586216 not found, creating... [ 832.469457] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.469457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.469857] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.469857] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.473278] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.473652] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.475408] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.475408] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: cb0da3d5-42de-4963-af1e-d5e418586216 is going to be created. [ 832.493805] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.494222] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.494588] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.495029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.495393] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.495744] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.849019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 832.849282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.384506] env[68828]: INFO networking_nsxv3.common.synchronization [req-11ba44b6-c37f-45d5-b14e-25d97237ba84 req-c460957f-f2c1-4661-a89c-c4a530b24f1e service nova] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 833.384726] env[68828]: INFO networking_nsxv3.common.synchronization [req-11ba44b6-c37f-45d5-b14e-25d97237ba84 req-c460957f-f2c1-4661-a89c-c4a530b24f1e service nova] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 833.384825] env[68828]: INFO networking_nsxv3.common.synchronization [req-11ba44b6-c37f-45d5-b14e-25d97237ba84 req-c460957f-f2c1-4661-a89c-c4a530b24f1e service nova] Enqueued Resource ID: cb0da3d5-42de-4963-af1e-d5e418586216 with Priority: HIGHEST for action port [ 833.385172] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_rules [ 833.385279] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 833.385328] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb0da3d5-42de-4963-af1e-d5e418586216 with Priority: HIGHEST for action port [ 833.386393] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.386524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.386594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.386799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.386883] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.387700] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.388161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.388256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.388457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.390837] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.390837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.390837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.390837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.390837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.391063] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.392469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb0da3d5-42de-4963-af1e-d5e418586216 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.392627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.392687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.392808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.392879] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb0da3d5-42de-4963-af1e-d5e418586216',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.893677] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.894420] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.894420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.895960] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb0da3d5-42de-4963-af1e-d5e418586216 with status ACTIVE [ 833.896171] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.896290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.896389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.896561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.896646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.896822] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.896919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.896981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.897152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.897221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.897424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.897517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.897577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.897715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.897788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.897873] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb0da3d5-42de-4963-af1e-d5e418586216 is going to be updated. [ 833.917247] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.917371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.917965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.917965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.917965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.917965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb0da3d5-42de-4963-af1e-d5e418586216" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.395645] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.898041] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.898041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.898041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.898041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.898606] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.898606] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be created. [ 834.922645] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.922861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.922861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.923225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.923387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.933018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: UNINITIALIZED for 2s [ 835.328444] env[68828]: INFO networking_nsxv3.common.synchronization [req-7d5ec96f-0ce7-444a-b9c1-fc152017ee55 req-7dbd3719-1a5c-4b24-8a48-ecc1aec0bc36 tempest-ServerMetadataNegativeTestJSON-450653616 tempest-ServerMetadataNegativeTestJSON-450653616-project-member] Enqueued Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_members [ 835.329127] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_members [ 835.329483] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.329606] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.329670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.329963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.330158] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.330262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.330328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.330482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.330577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.330669] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.789023] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-476 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.789023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-476" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.789023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-476" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.789943] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-476" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.790495] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.791835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.791835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.791835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.791835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.793023] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.793023] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.793023] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.793023] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.793023] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.793215] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.793463] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.814580] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.814861] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.815143] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.815424] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-476" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.815950] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.816147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.816349] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.816791] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.817039] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.833183] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.833183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.833183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.833325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.833374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.833572] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.833682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.833741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.833882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.834814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.834814] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 123868e6-4541-435b-9bd1-c8af4f43c09a already deleted. [ 835.834814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.319769] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.320137] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.320175] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.320487] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.320646] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.320809] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c not found, creating... [ 836.321111] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.321274] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.321393] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.321639] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.321778] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.322131] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.322317] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.322438] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.322650] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.322812] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.322991] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c is going to be created. [ 836.341729] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.341989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.342152] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.342437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.342666] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.342933] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.943701] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: SUCCESS [ 836.943889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.944090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.944330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.944596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.944728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.944795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.944971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.945105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.945196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.945294] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.451315] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.452549] env[68828]: INFO networking_nsxv3.common.synchronization [req-7d5ec96f-0ce7-444a-b9c1-fc152017ee55 req-c525ba6d-44f1-40e8-817d-ebe34048d350 service nova] Enqueued Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_rules [ 837.452721] env[68828]: INFO networking_nsxv3.common.synchronization [req-7d5ec96f-0ce7-444a-b9c1-fc152017ee55 req-c525ba6d-44f1-40e8-817d-ebe34048d350 service nova] Enqueued Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_members [ 837.452863] env[68828]: INFO networking_nsxv3.common.synchronization [req-7d5ec96f-0ce7-444a-b9c1-fc152017ee55 req-c525ba6d-44f1-40e8-817d-ebe34048d350 service nova] Enqueued Resource ID: b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c with Priority: HIGHEST for action port [ 837.453748] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_rules [ 837.453882] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_members [ 837.453974] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c with Priority: HIGHEST for action port [ 837.454382] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.454514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.454582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.454839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.454921] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.455686] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.455798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.455865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.456039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.456183] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.456275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.456335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.456474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.456554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.456638] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.459534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.459910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.459910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.459910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.460072] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.954812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc128506-c5e7-4179-a805-6679a20e9957: rpc.has_security_group_logging(os_id): False [ 837.961750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.961927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.962160] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.963118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c with status ACTIVE [ 837.963315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.963441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.963492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.963709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.963840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.963980] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.964257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.964257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.964381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.964468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.964652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.964743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.964792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.964937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.965053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.965105] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c is going to be updated. [ 837.976474] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.976592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.976693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.976877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.976971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.977230] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.977333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.977401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.977554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.977631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.977719] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be created. [ 837.988217] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.988427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.988427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.988638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.988745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.989021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b659f07f-b6fc-4f1b-a4c4-e7d0bef7fc0c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.033534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.033814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.033814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.034059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.034300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.047091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: IN_PROGRESS for 2s [ 838.467662] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.970547] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.970709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.970800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.971028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.971119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.971226] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 123868e6-4541-435b-9bd1-c8af4f43c09a is going to be created. [ 838.996409] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.996409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.996409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.996615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.996690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.006191] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 123868e6-4541-435b-9bd1-c8af4f43c09a in Status: UNINITIALIZED for 2s [ 840.060857] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: SUCCESS [ 840.061150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.278386] env[68828]: INFO networking_nsxv3.common.synchronization [req-902bb740-0a4b-47b3-b9f6-793a0c36fbae req-f534cab7-51d7-46f4-b7f8-4d11c0a68664 tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 840.279257] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 840.279312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.279430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.279506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.283020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.283020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.283020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.283020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.283020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.283020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.283020] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.784688] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.016928] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 123868e6-4541-435b-9bd1-c8af4f43c09a in Status: SUCCESS [ 841.016928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.017113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.018052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.018052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.018052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.018052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.018052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.018052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.018052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.018052] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.287832] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.523017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.523264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.523329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.523633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.523898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.524070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.524160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.524724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.524724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.524724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.524881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.524933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.525035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.525234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.525375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.525467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.525516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.525721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.525871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.525981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.526086] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.790629] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.790772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.790808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.791037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.791140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.791250] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 841.815388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.815592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.815592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.816666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.816666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.824872] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 842.028152] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 123868e6-4541-435b-9bd1-c8af4f43c09a: rpc.has_security_group_logging(os_id): False [ 842.049028] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.049028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.049028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.049028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.049028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.049267] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.050234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.050234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.050234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.050234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.050234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.050855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.050999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.051207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.051294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.051564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.051671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.051735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.051935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.052158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.052273] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 123868e6-4541-435b-9bd1-c8af4f43c09a is going to be created. [ 842.111035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.111035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.111035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.111035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.111035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.120871] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 123868e6-4541-435b-9bd1-c8af4f43c09a in Status: IN_PROGRESS for 2s [ 843.836665] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 843.836923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.138533] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 123868e6-4541-435b-9bd1-c8af4f43c09a in Status: SUCCESS [ 844.138622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.968045] env[68828]: INFO networking_nsxv3.common.synchronization [req-918221aa-4790-446d-ad44-0632478d7b15 req-676fd0fc-1dda-49f1-a562-7100e8e601ae tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_members [ 844.968402] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_members [ 844.969180] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.969180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.969180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.969317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.969410] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.969526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.969553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.969690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.969785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.970342] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.298193] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.298396] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.298523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.298854] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.299200] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.299374] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.299497] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.299725] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.299911] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.300195] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.300317] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.300430] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.300551] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.300663] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.300793] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.300923] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.319678] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.319827] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.319960] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.320147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.320432] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-570b40c4-b6ba-4726-bb04-58ae782a4d0b taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.320599] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.320719] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.321032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.321161] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('570b40c4-b6ba-4726-bb04-58ae782a4d0b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.474012] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.474204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.474284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.474524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.474616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.474823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.474921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.474984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.475170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.475288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.475383] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d03381a0-8611-467b-849f-03e37e47978c already deleted. [ 845.475468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.823214] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.823475] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.823607] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.823924] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.824113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.824284] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 570b40c4-b6ba-4726-bb04-58ae782a4d0b not found, creating... [ 845.824545] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.824706] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.824828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.825122] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.825311] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.829019] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.829019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.829019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.829019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.829019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.829019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 570b40c4-b6ba-4726-bb04-58ae782a4d0b is going to be created. [ 845.845732] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.846030] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.846230] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.846582] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.846890] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.847182] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.568674] env[68828]: INFO networking_nsxv3.common.synchronization [req-918221aa-4790-446d-ad44-0632478d7b15 req-a782e062-f5e6-4ee9-83d7-096fefa029ad service nova] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_rules [ 846.568914] env[68828]: INFO networking_nsxv3.common.synchronization [req-918221aa-4790-446d-ad44-0632478d7b15 req-a782e062-f5e6-4ee9-83d7-096fefa029ad service nova] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_members [ 846.569282] env[68828]: INFO networking_nsxv3.common.synchronization [req-918221aa-4790-446d-ad44-0632478d7b15 req-a782e062-f5e6-4ee9-83d7-096fefa029ad service nova] Enqueued Resource ID: 570b40c4-b6ba-4726-bb04-58ae782a4d0b with Priority: HIGHEST for action port [ 846.569539] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_rules [ 846.569674] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_members [ 846.569776] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 570b40c4-b6ba-4726-bb04-58ae782a4d0b with Priority: HIGHEST for action port [ 846.570088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.570226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.570325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.570491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.570626] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.573176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.573176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.573176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.573176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.573176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.573418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.573418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.573418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.573511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.573566] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.574289] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-570b40c4-b6ba-4726-bb04-58ae782a4d0b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.574380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.574609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.574609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.574673] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('570b40c4-b6ba-4726-bb04-58ae782a4d0b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.076637] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.078669] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.079670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.079670] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 570b40c4-b6ba-4726-bb04-58ae782a4d0b with status ACTIVE [ 847.080475] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.080475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.080475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.081185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.081185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.081369] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.081645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.084536] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.084536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.084536] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 570b40c4-b6ba-4726-bb04-58ae782a4d0b is going to be updated. [ 847.104034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.104170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.104248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.104521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.104667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.104833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-570b40c4-b6ba-4726-bb04-58ae782a4d0b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.585403] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.089717] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.091476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.091476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.091476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.091476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.091476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d03381a0-8611-467b-849f-03e37e47978c is going to be created. [ 848.116138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.116484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.116484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.117981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.117981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.125509] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: UNINITIALIZED for 2s [ 850.136017] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: SUCCESS [ 850.136017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.136392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.136392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.136583] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.136583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.136689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.136898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.137054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.137140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.137256] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.283564] env[68828]: INFO networking_nsxv3.common.synchronization [req-527fb680-dc74-4221-9995-827f12ea074d req-f4ce952b-3197-4b92-93d2-4db0b005cab7 tempest-ServerMetadataNegativeTestJSON-450653616 tempest-ServerMetadataNegativeTestJSON-450653616-project-member] Enqueued Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_members [ 850.285110] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGHEST for action security_group_members [ 850.286561] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.286763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.286881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.288294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.288294] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.288294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.288294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.288913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.289222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.289700] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.640361] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.793526] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.793692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.793762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.793994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.794112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.794348] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.794451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.794523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.794670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.794745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.794834] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 123868e6-4541-435b-9bd1-c8af4f43c09a is going to be updated. [ 850.835734] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.835734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.835734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.836817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.837041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.846110] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 123868e6-4541-435b-9bd1-c8af4f43c09a in Status: IN_PROGRESS for 2s [ 851.141389] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d03381a0-8611-467b-849f-03e37e47978c: rpc.has_security_group_logging(os_id): False [ 851.164256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.164256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.164256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.164256] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d03381a0-8611-467b-849f-03e37e47978c is going to be created. [ 851.234040] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.234310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.234637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.234637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.234776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.244701] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: IN_PROGRESS for 2s [ 852.034658] env[68828]: INFO networking_nsxv3.common.synchronization [req-6d6438d0-19e9-4015-8838-fec884cc4966 req-2e5c5b42-71bc-4d5e-9f48-0ce8c4b5e0aa tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 852.034658] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 852.034658] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.034658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.034658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.034658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.035016] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.035285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.035475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.035752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.035955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.036177] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.375344] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.375639] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.375683] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.375995] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.377261] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.377261] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.377261] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.377462] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.377617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.377851] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.377970] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.378098] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.378219] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.378707] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.378707] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.378707] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.396913] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.397116] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.397271] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.397456] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.397768] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-d80f8447-5d40-4876-bef9-a84e3a94279f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.397970] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.398120] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.398468] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.398613] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80f8447-5d40-4876-bef9-a84e3a94279f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.538431] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.538688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.538688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.538898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.538988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.539206] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.539306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.539370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.539523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.539600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.539685] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 already deleted. [ 852.539790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.677203] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9f947c30-ff84-4f60-a696-609cde660fd8 None None] Enqueued Resource ID: ec879d7f-e37b-4cba-a700-9d01bc7524c4 with Priority: HIGHEST for action port [ 852.677749] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec879d7f-e37b-4cba-a700-9d01bc7524c4 with Priority: HIGHEST for action port [ 852.678083] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec879d7f-e37b-4cba-a700-9d01bc7524c4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.678216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec879d7f-e37b-4cba-a700-9d01bc7524c4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.678283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec879d7f-e37b-4cba-a700-9d01bc7524c4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.678535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec879d7f-e37b-4cba-a700-9d01bc7524c4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.678620] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec879d7f-e37b-4cba-a700-9d01bc7524c4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.859819] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 123868e6-4541-435b-9bd1-c8af4f43c09a in Status: SUCCESS [ 852.860016] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 123868e6-4541-435b-9bd1-c8af4f43c09a deletion is rescheduled due to dependency. [ 852.860144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.906875] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.906875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port d80f8447-5d40-4876-bef9-a84e3a94279f not found, creating... [ 852.906875] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.906875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.907394] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.907650] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.907915] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.908263] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.908544] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.908793] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: d80f8447-5d40-4876-bef9-a84e3a94279f is going to be created. [ 852.929322] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.929322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.929322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.929322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.929322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.929322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.184655] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec879d7f-e37b-4cba-a700-9d01bc7524c4 [ 853.184655] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.184655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.184655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.184655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.184655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.184655] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec879d7f-e37b-4cba-a700-9d01bc7524c4 already deleted. [ 853.184655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec879d7f-e37b-4cba-a700-9d01bc7524c4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.257037] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: SUCCESS [ 853.257264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.682194] env[68828]: INFO networking_nsxv3.common.synchronization [req-6d6438d0-19e9-4015-8838-fec884cc4966 req-66d81fc4-df7a-4d09-a32b-e040c18d6a1e service nova] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_rules [ 853.682194] env[68828]: INFO networking_nsxv3.common.synchronization [req-6d6438d0-19e9-4015-8838-fec884cc4966 req-66d81fc4-df7a-4d09-a32b-e040c18d6a1e service nova] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 853.682194] env[68828]: INFO networking_nsxv3.common.synchronization [req-6d6438d0-19e9-4015-8838-fec884cc4966 req-66d81fc4-df7a-4d09-a32b-e040c18d6a1e service nova] Enqueued Resource ID: d80f8447-5d40-4876-bef9-a84e3a94279f with Priority: HIGHEST for action port [ 853.682194] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_rules [ 853.682194] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 853.682194] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d80f8447-5d40-4876-bef9-a84e3a94279f with Priority: HIGHEST for action port [ 853.682194] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.682194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.682194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.682194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.682194] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.689107] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.689107] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.689107] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.689107] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d80f8447-5d40-4876-bef9-a84e3a94279f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.689107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.689802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.690090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.690257] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80f8447-5d40-4876-bef9-a84e3a94279f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.825439] env[68828]: INFO networking_nsxv3.common.synchronization [None req-34c9ff6a-06a1-4707-b0b2-f59e843be91f tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_rules [ 853.825841] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_rules [ 853.826162] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.826285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.826354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.826592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.826676] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.946509] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5fa88a27-d035-4ed1-a848-84d086a83a76 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_rules [ 853.947065] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_rules [ 853.947343] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.947575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.192729] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.194315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.194469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.194975] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d80f8447-5d40-4876-bef9-a84e3a94279f with status ACTIVE [ 854.195206] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.196157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.196157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.196157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.196157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.197396] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.197654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.197718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.197981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.198162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.198558] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.198761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.199131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.199693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.199853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.200053] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d80f8447-5d40-4876-bef9-a84e3a94279f is going to be updated. [ 854.232256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.232446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.232545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.232811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.233012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.233224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d80f8447-5d40-4876-bef9-a84e3a94279f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.347243] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.347956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.348109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.348340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.348428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.349217] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 already deleted. [ 854.349217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.349217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.349217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.349217] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.528123] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ae228022-51f5-46f9-9a49-263fab3c481b None None] Enqueued Resource ID: ace5c78b-d862-4ddb-aed3-97ccaddc5933 with Priority: HIGHEST for action port [ 854.528392] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace5c78b-d862-4ddb-aed3-97ccaddc5933 with Priority: HIGHEST for action port [ 854.528939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ace5c78b-d862-4ddb-aed3-97ccaddc5933 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.529075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ace5c78b-d862-4ddb-aed3-97ccaddc5933" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.529140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ace5c78b-d862-4ddb-aed3-97ccaddc5933" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.529385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ace5c78b-d862-4ddb-aed3-97ccaddc5933" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.529492] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ace5c78b-d862-4ddb-aed3-97ccaddc5933',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.572222] env[68828]: INFO networking_nsxv3.common.synchronization [req-7af7c9c6-10e9-4f5f-92de-b25a43b5c40e req-3498fc84-2ee9-406a-9329-59faad24a4bc tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 854.572734] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 854.573074] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.573202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.573280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.573482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.573634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.573909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.573909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.573909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.574075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.574563] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.698732] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.871859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.872074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.872180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.872605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.872708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.872810] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 already deleted. [ 854.872894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.032415] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ace5c78b-d862-4ddb-aed3-97ccaddc5933 [ 855.032716] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.032893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.032969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.033330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.033330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.033643] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ace5c78b-d862-4ddb-aed3-97ccaddc5933 already deleted. [ 855.033643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ace5c78b-d862-4ddb-aed3-97ccaddc5933" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.077957] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.078201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.078279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.078532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.078666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.078907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.079024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.079115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.079290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.079363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.079454] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be deleted. [ 855.098188] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.098523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.098739] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.099158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.099444] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.099687] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.099741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.099949] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.100112] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.100332] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.100449] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.100634] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.100787] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.102721] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.102721] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.102721] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.113443] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.113443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.113443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.113443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.113443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.113443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.122144] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.122361] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 855.122503] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.123269] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.123269] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-e9f7851f-618f-4314-82b5-cdd3f3b5164b taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.123269] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.123500] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.123739] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.123804] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9f7851f-618f-4314-82b5-cdd3f3b5164b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.202021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.202218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.202308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.202515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.202608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.202713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be created. [ 855.229965] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.230108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.230180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.230391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.230546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.254083] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: UNINITIALIZED for 2s [ 855.626711] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.627119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.627119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.627416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.627857] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.627857] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port e9f7851f-618f-4314-82b5-cdd3f3b5164b not found, creating... [ 855.628051] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.628694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.628694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.628694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.628694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.629076] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.629076] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.629194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.629402] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.629539] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.629682] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: e9f7851f-618f-4314-82b5-cdd3f3b5164b is going to be created. [ 855.649085] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.649310] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.649438] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.649707] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.649934] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.650201] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.334203] env[68828]: INFO networking_nsxv3.common.synchronization [req-7af7c9c6-10e9-4f5f-92de-b25a43b5c40e req-70ec64e6-6fb8-47be-a56d-d00d22fe878b service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 856.334514] env[68828]: INFO networking_nsxv3.common.synchronization [req-7af7c9c6-10e9-4f5f-92de-b25a43b5c40e req-70ec64e6-6fb8-47be-a56d-d00d22fe878b service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 856.334564] env[68828]: INFO networking_nsxv3.common.synchronization [req-7af7c9c6-10e9-4f5f-92de-b25a43b5c40e req-70ec64e6-6fb8-47be-a56d-d00d22fe878b service nova] Enqueued Resource ID: e9f7851f-618f-4314-82b5-cdd3f3b5164b with Priority: HIGHEST for action port [ 856.334807] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 856.334891] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 856.334987] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f7851f-618f-4314-82b5-cdd3f3b5164b with Priority: HIGHEST for action port [ 856.335535] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.335659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.335728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.335919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.335999] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.337317] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.337428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.337496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.337660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.337802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.337894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.337957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.338109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.342076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.342076] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.342076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9f7851f-618f-4314-82b5-cdd3f3b5164b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.342076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.342076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.342076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.342076] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9f7851f-618f-4314-82b5-cdd3f3b5164b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.841679] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.841816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.844222] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9f7851f-618f-4314-82b5-cdd3f3b5164b with status ACTIVE [ 856.844415] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.844535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.844604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.844808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.844897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.845079] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.845180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.845238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.845388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.845465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.845634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.845772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.845772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.845911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.845981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.846075] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9f7851f-618f-4314-82b5-cdd3f3b5164b is going to be updated. [ 856.847170] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.865816] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.866084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.866084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.866961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.866961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.866961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9f7851f-618f-4314-82b5-cdd3f3b5164b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.262602] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 857.262866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.263107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.263362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.263760] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.263760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.263760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.263924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.264028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.264136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.264238] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.349905] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.766924] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.767111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.767183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.767403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.767578] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.767678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.767743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.767896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.767984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.768087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.768232] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.768322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.768381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.768518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.768652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.768739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.768798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.768930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.769014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.769099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.769185] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.852469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.852805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.852923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.853258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.853407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.853597] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be created. [ 857.884940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.885130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.885203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.885426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.885645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.895301] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: UNINITIALIZED for 2s [ 858.271449] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e63aa4-edf9-4cdd-b540-1791bfdc42d4: rpc.has_security_group_logging(os_id): False [ 858.288611] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.288803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.288900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.289117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.289233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.289470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.289599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.289656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.289786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.289880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.290076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.290182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.290235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.290398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.290474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.290662] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.290769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.290816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.290960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.291062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.291167] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be created. [ 858.346007] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.346175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.346240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.346444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.346622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.361300] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 859.905163] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 859.905449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.905513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.905737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.905929] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.906058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.906128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.906282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.906362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.906450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.906538] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.374133] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 860.374133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.409053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.409053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.409053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.409318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.409526] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.409659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.409729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.410339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.410339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.410339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.410502] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.410502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.410575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.410719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.410890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.411015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.411085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.411274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.411382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.411490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.411600] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.914023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fb8087b-3cde-4101-b157-953a51b3561f: rpc.has_security_group_logging(os_id): False [ 860.951352] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.951570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.951673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.951983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.952173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.952451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.952592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.952686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.952918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.953215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.953402] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.953541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.953637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.954468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.954566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.954760] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.954856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.954915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.955099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.955260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.955260] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be created. [ 861.019149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.019305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.019391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.019659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.019891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.032819] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 861.335871] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 861.335871] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 861.491364] env[68828]: INFO networking_nsxv3.common.synchronization [req-4c4a4993-d4d8-4e59-b2e9-8656c7e50dea req-d1ec91a1-cba0-4d33-bbf4-c69b824b0fce tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 861.491889] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 861.492233] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.492349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.492420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.492618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.492773] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.492871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.492935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.493625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.493753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.493810] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.752395] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.752630] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.752784] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.753091] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.753390] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.754174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.754174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.754174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.754174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.754510] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.754510] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.754510] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.754714] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.754714] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.754811] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.754946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.775582] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.775846] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.776361] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.776361] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-239" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.776586] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.777020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.777020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.777486] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.778401] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e2a2dd-ea93-40f2-a439-3bdf47184ce3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.995787] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.281631] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.281631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.281631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.281631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.281631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.281906] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 not found, creating... [ 862.281964] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.282174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.282300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.282521] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.282664] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.283789] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.283789] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.283789] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.283789] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.283789] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.283789] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 is going to be created. [ 862.308778] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.308991] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.309136] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.309404] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.309649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.309886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.499413] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.002338] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.002670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.002670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.002783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.002886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.002983] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 863.014735] env[68828]: INFO networking_nsxv3.common.synchronization [req-4c4a4993-d4d8-4e59-b2e9-8656c7e50dea req-3e8debfe-ede4-475a-8686-64a290dc50a9 service nova] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 863.014954] env[68828]: INFO networking_nsxv3.common.synchronization [req-4c4a4993-d4d8-4e59-b2e9-8656c7e50dea req-3e8debfe-ede4-475a-8686-64a290dc50a9 service nova] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 863.015109] env[68828]: INFO networking_nsxv3.common.synchronization [req-4c4a4993-d4d8-4e59-b2e9-8656c7e50dea req-3e8debfe-ede4-475a-8686-64a290dc50a9 service nova] Enqueued Resource ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with Priority: HIGHEST for action port [ 863.015631] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 863.015765] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 863.015862] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with Priority: HIGHEST for action port [ 863.018041] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.018041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.018041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.018041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.018041] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.018631] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.019248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.019248] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.019248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.019248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.019443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.019472] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e2a2dd-ea93-40f2-a439-3bdf47184ce3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.029160] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.029337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.029409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.029614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.029783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.038280] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 863.047551] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 863.047815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.521872] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with status ACTIVE [ 863.522094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.522313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.522375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.522549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.522640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.522818] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.522928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.522976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.523143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.523241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.523542] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.523542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.523542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.523688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.523719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.523802] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 is going to be updated. [ 863.524986] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.525113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.543649] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.547073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.547073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.547073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.547073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.547073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.670904] env[68828]: INFO networking_nsxv3.common.synchronization [req-538ebf3c-868a-45b4-af40-d9c64a420f0a req-c5daa2e6-38e1-4003-b643-765c048a69c9 tempest-VolumesAdminNegativeTest-51626435 tempest-VolumesAdminNegativeTest-51626435-project-member] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_members [ 863.670998] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGHEST for action security_group_members [ 863.671771] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.671771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.671771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.671771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.672242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.672242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.672242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.672366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.672394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.672476] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.128833] env[68828]: INFO networking_nsxv3.common.synchronization [req-84b94e64-a365-4254-884a-23848a06d914 req-1f3922fd-4582-4326-b1f1-5eea9447b0db tempest-ListServerFiltersTestJSON-1826443975 tempest-ListServerFiltersTestJSON-1826443975-project-member] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 864.129210] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 864.129547] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.130111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.130111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.130732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.130938] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.131094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.131187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.131380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.131549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.131674] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.176134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.176344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.176448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.176696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.177420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.177671] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.178177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.181158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.181359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.181452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.181549] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 is going to be updated. [ 864.208276] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.208440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.208566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.208727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.208789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.217803] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: IN_PROGRESS for 2s [ 864.431191] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.431603] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.431603] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.432077] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.432525] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.432704] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.432833] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.433090] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.433276] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.433498] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.433622] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.433736] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.434665] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.436253] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.437679] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.439162] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.457808] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.457990] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.458176] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.458373] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.458720] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ecee7505-fd6e-46ce-9b32-07d6e442520f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.458896] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.459031] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.459368] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.459511] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecee7505-fd6e-46ce-9b32-07d6e442520f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.635038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.635142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.635900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.635900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.635900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.636267] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.636267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.636347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.636438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.636568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.636694] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd already deleted. [ 864.637253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.964029] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.964029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.964029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.964029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.964029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.964029] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ecee7505-fd6e-46ce-9b32-07d6e442520f not found, creating... [ 864.964029] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.964029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.964029] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.969203] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.969486] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.969786] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.970017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.970109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.970379] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.970548] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.970716] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ecee7505-fd6e-46ce-9b32-07d6e442520f is going to be created. [ 864.990691] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.990925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.991069] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.991355] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.992095] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.992095] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.050018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 865.050018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.050018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.050018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.051476] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.051476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.051476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.051476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.051476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.051476] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.553129] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.665624] env[68828]: INFO networking_nsxv3.common.synchronization [req-84b94e64-a365-4254-884a-23848a06d914 req-c4a7bd86-2104-4f63-a1fc-5af0329b2606 service nova] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_rules [ 865.665815] env[68828]: INFO networking_nsxv3.common.synchronization [req-84b94e64-a365-4254-884a-23848a06d914 req-c4a7bd86-2104-4f63-a1fc-5af0329b2606 service nova] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 865.665958] env[68828]: INFO networking_nsxv3.common.synchronization [req-84b94e64-a365-4254-884a-23848a06d914 req-c4a7bd86-2104-4f63-a1fc-5af0329b2606 service nova] Enqueued Resource ID: ecee7505-fd6e-46ce-9b32-07d6e442520f with Priority: HIGHEST for action port [ 865.666459] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_rules [ 865.666593] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 865.666695] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecee7505-fd6e-46ce-9b32-07d6e442520f with Priority: HIGHEST for action port [ 865.666958] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.667648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.667731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.667976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.668098] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.669267] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.669374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.669446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.670565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.670565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.670565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.670565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.670565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.670741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.670741] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.672646] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecee7505-fd6e-46ce-9b32-07d6e442520f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.672646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.672646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.672886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.672986] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecee7505-fd6e-46ce-9b32-07d6e442520f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.055598] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.169887] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.170079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.172477] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.174651] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecee7505-fd6e-46ce-9b32-07d6e442520f with status ACTIVE [ 866.175039] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.175280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.175430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.175661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.175753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.175942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.176067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.176129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.176283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.176364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.176544] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.176637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.176691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.176827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.176901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.177076] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecee7505-fd6e-46ce-9b32-07d6e442520f is going to be updated. [ 866.196930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.196930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.196930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.196930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.196930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.196930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecee7505-fd6e-46ce-9b32-07d6e442520f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.227345] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 in Status: SUCCESS [ 866.227537] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 deletion is rescheduled due to dependency. [ 866.227652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.558241] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.558576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.558576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.558698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.558791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.558896] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 866.636267] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.636425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.636557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.636713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.636843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.647019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 866.679517] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.734997] env[68828]: INFO networking_nsxv3.common.synchronization [req-b3c6691a-b85d-4c8a-a108-430772e06f47 req-15df8485-28cc-4641-ba0b-6afa579fdc6d tempest-ListServerFiltersTestJSON-1826443975 tempest-ListServerFiltersTestJSON-1826443975-project-member] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 866.735672] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 866.736094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.736716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.993822] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.994082] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.994243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.994633] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.995480] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.995480] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.995682] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.995887] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.996105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.996812] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.996812] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.996812] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.996812] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.997025] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.997025] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.997191] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.013881] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.014113] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.014277] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.014503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.014854] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-27a0f409-24f9-4287-8e51-2fe1f39a7e90 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.015087] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.015268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.015613] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.015799] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27a0f409-24f9-4287-8e51-2fe1f39a7e90',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.182513] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.182513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.182513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.183026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.183026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.183582] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be created. [ 867.208067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.209099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.209348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.209581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.209749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.219169] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: UNINITIALIZED for 2s [ 867.521034] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521034] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 27a0f409-24f9-4287-8e51-2fe1f39a7e90 not found, creating... [ 867.521034] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.521034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521566] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.521566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.521566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.521566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.521566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521899] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 27a0f409-24f9-4287-8e51-2fe1f39a7e90 is going to be created. [ 867.544043] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.544043] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.544043] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.544043] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.544043] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.544043] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.500919] env[68828]: INFO networking_nsxv3.common.synchronization [req-b3c6691a-b85d-4c8a-a108-430772e06f47 req-72ef7bca-05a6-4730-aec4-1b566ec33081 service nova] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_rules [ 868.501221] env[68828]: INFO networking_nsxv3.common.synchronization [req-b3c6691a-b85d-4c8a-a108-430772e06f47 req-72ef7bca-05a6-4730-aec4-1b566ec33081 service nova] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 868.501255] env[68828]: INFO networking_nsxv3.common.synchronization [req-b3c6691a-b85d-4c8a-a108-430772e06f47 req-72ef7bca-05a6-4730-aec4-1b566ec33081 service nova] Enqueued Resource ID: 27a0f409-24f9-4287-8e51-2fe1f39a7e90 with Priority: HIGHEST for action port [ 868.501482] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_rules [ 868.501608] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 868.501703] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a0f409-24f9-4287-8e51-2fe1f39a7e90 with Priority: HIGHEST for action port [ 868.502294] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.502646] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.503570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-27a0f409-24f9-4287-8e51-2fe1f39a7e90 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.503570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.503570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.503784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.503784] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27a0f409-24f9-4287-8e51-2fe1f39a7e90',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.659031] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.659031] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.659031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.659031] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.007742] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27a0f409-24f9-4287-8e51-2fe1f39a7e90 with status ACTIVE [ 869.007742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.007742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.007742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.007742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.008430] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27a0f409-24f9-4287-8e51-2fe1f39a7e90 is going to be updated. [ 869.027618] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.027810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.027908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.028215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.028406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.028616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27a0f409-24f9-4287-8e51-2fe1f39a7e90" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.161178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.161178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.161178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.161178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.161414] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.161414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.161414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.161583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.161626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.161715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.161867] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.161965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.162045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.162249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.162405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.162514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.162602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.162751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.162828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.162911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.163011] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.228389] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 869.228599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.228754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.228972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.229169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.229285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.229352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.229502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.229583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.229668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.229769] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.230784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.230784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.230901] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.230970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.231127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.231231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.231312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.231399] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.665366] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9050286-eb81-4cbb-9bd8-733baee0e20c: rpc.has_security_group_logging(os_id): False [ 869.681538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.681621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.681657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.681855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.681946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.682182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.682292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.682361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.682522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.682599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.682804] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.682917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.682950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.683102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.683180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.683363] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.683454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.683515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.683648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.683721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.683804] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 869.734898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.735052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.735258] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.739118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.739242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.739312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.739535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.739679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.754165] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 870.241817] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.244895] env[68828]: INFO networking_nsxv3.common.synchronization [req-1d03107d-46c3-45bf-ad3f-5d02b955bfe1 req-f697b105-6f52-43be-8b8a-cf7a2d8d0d4f tempest-ListServerFiltersTestJSON-1826443975 tempest-ListServerFiltersTestJSON-1826443975-project-member] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 870.245555] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 870.245930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.246087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.590769] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.591026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.591444] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.591860] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.592513] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.592513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.592686] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.592897] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.592938] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.593177] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.593293] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.593413] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.593550] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.593671] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.593783] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.593924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.613129] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.613383] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.614066] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.614066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-120" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.614066] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-bd5b14b2-051c-4e35-9adf-295f7700a0c6 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.614302] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.614360] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.614701] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.614857] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5b14b2-051c-4e35-9adf-295f7700a0c6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.745075] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.745534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.745534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.745686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.745807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.745945] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 870.776037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.776037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.776037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.776037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.776037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.784710] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 871.117777] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.118297] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.118297] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.118482] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.118635] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.118804] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port bd5b14b2-051c-4e35-9adf-295f7700a0c6 not found, creating... [ 871.119091] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.120376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.120376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.120376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.120376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.120376] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.120376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.120838] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.120838] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.120838] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.120942] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: bd5b14b2-051c-4e35-9adf-295f7700a0c6 is going to be created. [ 871.140458] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.140679] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.140808] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.141100] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.141339] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.141578] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.772122] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 871.772620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.874728] env[68828]: INFO networking_nsxv3.common.synchronization [req-1d03107d-46c3-45bf-ad3f-5d02b955bfe1 req-7971d7a0-dc3b-4e13-b359-28fedd1abe4d service nova] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_rules [ 871.874728] env[68828]: INFO networking_nsxv3.common.synchronization [req-1d03107d-46c3-45bf-ad3f-5d02b955bfe1 req-7971d7a0-dc3b-4e13-b359-28fedd1abe4d service nova] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 871.874728] env[68828]: INFO networking_nsxv3.common.synchronization [req-1d03107d-46c3-45bf-ad3f-5d02b955bfe1 req-7971d7a0-dc3b-4e13-b359-28fedd1abe4d service nova] Enqueued Resource ID: bd5b14b2-051c-4e35-9adf-295f7700a0c6 with Priority: HIGHEST for action port [ 871.874924] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_rules [ 871.875044] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 871.875146] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd5b14b2-051c-4e35-9adf-295f7700a0c6 with Priority: HIGHEST for action port [ 871.875707] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.876029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.876321] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.876420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.876609] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd5b14b2-051c-4e35-9adf-295f7700a0c6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.876711] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.876775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.876971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.877061] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd5b14b2-051c-4e35-9adf-295f7700a0c6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.379193] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd5b14b2-051c-4e35-9adf-295f7700a0c6 with status ACTIVE [ 872.379540] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.379743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.379858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.380175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.380340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.380664] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.380822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.380876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.381144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.381274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.381494] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.381626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.381694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.381873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.381975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.382307] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd5b14b2-051c-4e35-9adf-295f7700a0c6 is going to be updated. [ 872.403086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.403237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.403315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.403486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.403618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.403779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd5b14b2-051c-4e35-9adf-295f7700a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.795023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 872.795023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.795359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.795474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.795709] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.795833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.795912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.796090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.796175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.796273] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.299034] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.513885] env[68828]: INFO networking_nsxv3.common.synchronization [req-4a9e9d5e-56ca-4905-af5f-594a561bf750 req-fd3afe7c-7173-4a65-9321-1d8fd0e47ab7 tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 873.514559] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 873.514921] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.515129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.515247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.515505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.515697] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.515797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.516411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.516610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.516707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.516807] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.780176] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 873.780364] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 873.780807] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 873.780962] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 873.781581] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.781581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.781581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.781961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.781961] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.781961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.781961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.782557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.782672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.782772] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.783624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.783731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.783883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.784009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.784370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.784467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.784529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.784684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.784742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.784826] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.802261] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.846885] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_rules [ 873.848869] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 873.848869] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 873.848869] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 873.848869] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7f12c15-7706-46b4-85fe-f86042e1748d req-e3f9639d-73ab-4a67-affe-1731b7adf8a9 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with Priority: HIGHEST for action port [ 873.849927] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_rules [ 873.850176] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 873.850374] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with Priority: HIGHEST for action port [ 873.853019] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 873.853019] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 873.853019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.853019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.853019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.853019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.853019] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.853596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.853823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.853971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.854240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.854465] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.855435] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.855767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.855921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.856297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.856460] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e2a2dd-ea93-40f2-a439-3bdf47184ce3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.857310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.857513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.857849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.858044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.019566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.019566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.019566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.019793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.019793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.020648] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.020648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.020648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.020648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.020648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.020648] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 874.048452] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.048644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.048716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.048927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.049090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.057436] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 874.286407] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.287426] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.303949] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.304127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.304195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.304368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.304459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.304554] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 874.331570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.331712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.331753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.331951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.332130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.340333] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 874.359836] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.360287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.360592] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with status ACTIVE [ 874.360774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360888] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.360957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.361178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.361294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.361629] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.361760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.361831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.362026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.362175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.362388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.362511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.362576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.362740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.362824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.362917] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 is going to be updated. [ 874.384657] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.384657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.384657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.384657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.384868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.384914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.789537] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.791895] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.295821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.295821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.295821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.295821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.295821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.295821] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be created. [ 875.295821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.296338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.296338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.296338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.296338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.296338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 875.320256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.320256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.320256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.320443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.320443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.323200] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.323320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.323391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.323564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.324166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.330653] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: UNINITIALIZED for 2s [ 875.331257] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 876.069025] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 876.069235] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 deletion is rescheduled due to dependency. [ 876.069354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.353026] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 876.353848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.353848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.353848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.353848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.354022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.354022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.354179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.354264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.354352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.354517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.354602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.354666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.354809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.354947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.355056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.355119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.355254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.355331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.355409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.355505] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.356463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.356635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.356786] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.356887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.356951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.357105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.357193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.357284] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.861751] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 309bda50-1db3-47e1-b12b-431331217ccd: rpc.has_security_group_logging(os_id): False [ 876.861751] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.877841] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.877925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.877959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.878242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.878340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.878917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.878917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.878917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.878917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.878917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.879152] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.879197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.879255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.879397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.879473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.879660] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.879754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.879815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.879952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.880053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.880179] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be created. [ 876.883748] env[68828]: INFO networking_nsxv3.common.synchronization [req-ac9cec53-bec3-4048-8c05-02e971aa82b3 req-d2dc872b-bcdc-4068-b5e8-97854fa0a09a tempest-ServersAdminNegativeTestJSON-1903577502 tempest-ServersAdminNegativeTestJSON-1903577502-project-member] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 876.884239] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGHEST for action security_group_members [ 876.884579] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.884688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.884755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.884910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.885070] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.885164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.885226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.885365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.885438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.885524] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.931024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.931197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.931197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.931375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.931581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.941695] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 877.341638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 877.341871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.342041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.342305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.342492] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.342611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.342678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.342826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.342909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.342999] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.344418] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 877.344591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.344734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.344897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.345066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.345192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.345232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.345541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.345541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.345541] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.362754] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.387274] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.387521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.387604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.388176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.388176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.388176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.389151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.389151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.389151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.389151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.389151] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be updated. [ 877.414049] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.414225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.414331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.414573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.414715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.422497] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: IN_PROGRESS for 2s [ 877.847473] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.848530] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.864842] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.865089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.865089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.865294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.865357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.865459] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 877.905020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.905020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.905020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.905020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.905020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.917783] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 878.351110] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.352076] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.854220] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.854220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.854220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.854933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.854933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.854933] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 878.855977] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.856109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.856173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.856328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.856409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.856496] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be updated. [ 878.888939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.889103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.889167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.889366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.889514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.891405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.891405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.891710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.891763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.891890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.901382] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 878.902078] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: IN_PROGRESS for 2s [ 878.953255] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 878.953387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.953568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.953779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.954446] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.432048] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f82e204-74c2-4f16-ab6e-65554153de56 in Status: SUCCESS [ 879.432048] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 deletion is rescheduled due to dependency. [ 879.432048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.456665] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.456792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.928302] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 879.928661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.928661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.928891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.929058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.929185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.929255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.929402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.929484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.929592] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.431535] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.912010] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 880.912392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.913446] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 880.913688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.913907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.914217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.915045] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.915045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.915045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.915240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.915271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916252] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.917386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.917561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.917734] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.917866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.917924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.918134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.918267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.918377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.918471] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.933720] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.420052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.420218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.420294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.420512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.420693] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.420776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.420845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.420985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.421083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.421171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.421319] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.421410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.421470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.421605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.421799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.421905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.421967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.422188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.422252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.422335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.422427] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.423788] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.435181] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.435325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.435381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.435562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.435647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.435739] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 881.455426] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_members [ 881.456675] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 881.456675] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 881.456675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_members [ 881.456675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 881.456675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 881.456675] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-99081680-ef28-4c21-a011-b835eb2d3904 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.457411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.457411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.457411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.457411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.457574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.457574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.457990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.458144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.458270] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.459972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.460127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.460229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.460426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.460599] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.460722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.460803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.460967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.461090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.461202] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.462286] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.462529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.462632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.462812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.462990] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.463367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.463367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.463367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.463513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.463554] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.465231] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.465290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.465320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.465527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.465690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.474857] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 881.533888] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_rules [ 881.534083] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 881.534226] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_rules [ 881.534361] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_members [ 881.534491] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 881.534618] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 881.534746] env[68828]: INFO networking_nsxv3.common.synchronization [req-ae10f3f6-b584-471a-8434-3bddfc374253 req-63521140-daa3-4446-be30-721dba4db690 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with Priority: HIGHEST for action port [ 881.538336] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_rules [ 881.538427] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_rules [ 881.538838] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 881.538959] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with Priority: HIGHEST for action port [ 881.539068] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_rules [ 881.539161] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 881.539248] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_members [ 881.539522] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.539622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.539819] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99081680-ef28-4c21-a011-b835eb2d3904 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.539918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.539982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.540262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.540342] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.541158] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.541258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.541447] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.541547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.541610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.541773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.541849] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e2a2dd-ea93-40f2-a439-3bdf47184ce3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.545065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.545065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.545065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.545065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.545065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-99081680-ef28-4c21-a011-b835eb2d3904 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.545065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.925441] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9050286-eb81-4cbb-9bd8-733baee0e20c: rpc.has_security_group_logging(os_id): False [ 881.926436] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0772c5f0-7902-49dd-8073-f3ce338b4a68: rpc.has_security_group_logging(os_id): False [ 881.945072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.947459] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.947459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.947459] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be created. [ 881.952223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.952223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.952223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.952223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.954020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.954020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.954020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.954020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.954020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.954020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.954020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 881.961149] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.963883] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.964677] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.008315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.008504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.008554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.008779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.008971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.015681] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.015886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.016012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.016316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.016542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.029953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: IN_PROGRESS for 2s [ 882.042708] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 882.044192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-99081680-ef28-4c21-a011-b835eb2d3904 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.044376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.044541] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 with status ACTIVE [ 882.044734] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.044845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.044908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.045120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.045216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.045382] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.045484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.045544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.045713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.045789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.045994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.046111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.046165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.046346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.046416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.046627] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04e2a2dd-ea93-40f2-a439-3bdf47184ce3 is going to be updated. [ 882.097026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.097226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.097271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.097528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.097680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.097840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04e2a2dd-ea93-40f2-a439-3bdf47184ce3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.391906] env[68828]: INFO networking_nsxv3.common.synchronization [req-310127bf-b37f-4e2b-8901-99248e6b3f41 req-c8b33017-5e3f-45a3-9f63-cb97811d92d9 tempest-ServerRescueTestJSON-1908369248 tempest-ServerRescueTestJSON-1908369248-project-member] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 882.392646] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGHEST for action security_group_members [ 882.393033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.393193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.393305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.393463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.393653] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.393809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.394222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.394222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.394222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.394534] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.464990] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.466609] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.467959] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.897603] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.897787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.897827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.898073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.898259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.898448] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.898663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.898741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.898941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.899042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.899139] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be updated. [ 882.936079] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.936456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.936456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.936774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.936888] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.947813] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: IN_PROGRESS for 2s [ 882.968403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.968757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.968950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.969320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.969439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.969762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be updated. [ 882.971035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.971227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.971291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.971552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.971673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.971813] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 is going to be created. [ 882.973368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.973577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.973669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.973835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.973993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.974065] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 883.004734] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.005032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.005186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.005529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.005803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.009034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.009289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.009289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.009431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.009566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.011286] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.011437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.011503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.011658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.011782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.021976] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 883.022677] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: IN_PROGRESS for 2s [ 883.023348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99081680-ef28-4c21-a011-b835eb2d3904 in Status: UNINITIALIZED for 2s [ 883.484421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 883.484668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.484833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.485051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.485248] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.485370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.485437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.485592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.485672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.485758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.485846] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.987729] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.988079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.988079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.988189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.988359] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.988465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.988543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.988678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.988766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.988856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.988999] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.989103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.989164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.989338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.989437] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.989526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.989633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.989713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.989802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.989861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.989945] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.042058] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 884.042058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.042334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.042461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.042494] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.055314] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 884.055525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.055947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.056165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.056273] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.231664] env[68828]: INFO networking_nsxv3.common.synchronization [req-0949fc94-7021-4209-a040-5f0b650bda44 req-488426ee-7b04-4637-99b5-989e13429396 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_members [ 884.231843] env[68828]: INFO networking_nsxv3.common.synchronization [req-0949fc94-7021-4209-a040-5f0b650bda44 req-488426ee-7b04-4637-99b5-989e13429396 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 884.231981] env[68828]: INFO networking_nsxv3.common.synchronization [req-0949fc94-7021-4209-a040-5f0b650bda44 req-488426ee-7b04-4637-99b5-989e13429396 tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 884.232532] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99081680-ef28-4c21-a011-b835eb2d3904 with Priority: HIGHEST for action security_group_members [ 884.232662] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGHEST for action security_group_members [ 884.232758] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 884.233108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-99081680-ef28-4c21-a011-b835eb2d3904 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.233242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.233472] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.233560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.233824] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.233824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.492128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 309bda50-1db3-47e1-b12b-431331217ccd: rpc.has_security_group_logging(os_id): False [ 884.509021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.509180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.509251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.509460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.509551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.509744] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.509839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.509904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.510137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.510231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.510432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.510526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.510584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.510725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.510799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.511016] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.511123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.511123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.511266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.511330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.511417] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 884.545720] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.545853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.558558] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.558761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.564284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.564408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.564480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.564689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.564833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.575212] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 884.958704] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d51724-5116-4cde-bbe3-36293e35d81b in Status: SUCCESS [ 884.958980] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b deletion is rescheduled due to dependency. [ 884.958980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.032438] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 885.032829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.032829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.032951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.033169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.033303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.033371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.033542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.033626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.033725] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.037998] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 885.038190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.038824] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99081680-ef28-4c21-a011-b835eb2d3904 in Status: SUCCESS [ 885.038984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.039136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.039306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.039469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.039573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.039631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.039763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.039832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.039920] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.040891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.040891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.041033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.041084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.041220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.041284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.041363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.041444] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.544082] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.545367] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.545367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.545456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.545890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.545890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.545890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.546014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.546014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.546145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.546215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.546318] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be updated. [ 885.547636] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.547636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.547636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.547893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.547941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.548105] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.548350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.548350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.548620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.548712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.548809] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 is going to be deleted. [ 885.572758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.572922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.572961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.573208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.573307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.576134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.576258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.576338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.576515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.576598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.576692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.576824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.577416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.577416] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.577416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.577416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.577416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.577629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.577629] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.582682] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: IN_PROGRESS for 2s [ 886.053135] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.083445] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.083445] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.083445] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 already deleted. [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.083445] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.083445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.084624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.084624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.084624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.084624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.084624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.084828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.084828] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.554896] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.555035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.555135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.555343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.555437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.555558] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 886.586941] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99081680-ef28-4c21-a011-b835eb2d3904',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.590645] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.590805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.591174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.591404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.591554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.592878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.592992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.593074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.593253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.593341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.593520] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.593617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.593678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.593820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.593895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.593976] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 already deleted. [ 886.594070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.602036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 886.602143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.602270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.602444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.602526] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.603762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 887.090743] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99081680-ef28-4c21-a011-b835eb2d3904: rpc.has_security_group_logging(os_id): False [ 887.105815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.106157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.106157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.106265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.106443] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.106580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.106615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.106746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.106833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.106920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.107049] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.108634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.108745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.108813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.108969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.109070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.109277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.109373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.109436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.109695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.109695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.109748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 is going to be created. [ 887.125570] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/99081680-ef28-4c21-a011-b835eb2d3904], does not exist path=[/infra/domains/default/groups/99081680-ef28-4c21-a011-b835eb2d3904]."\n}' [ 887.125570] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/99081680-ef28-4c21-a011-b835eb2d3904 [ 887.125766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 887.169915] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.170079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.170143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.170357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.171427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.171702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.171812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.171877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.172046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.172127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.172398] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.172990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.172990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.172990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.172990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.172990] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99081680-ef28-4c21-a011-b835eb2d3904 is going to be created. [ 887.189451] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/99081680-ef28-4c21-a011-b835eb2d3904], does not exist path=[/infra/domains/default/groups/99081680-ef28-4c21-a011-b835eb2d3904]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/99081680-ef28-4c21-a011-b835eb2d3904 [ 887.189588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99081680-ef28-4c21-a011-b835eb2d3904" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.189769] env[68828]: Traceback (most recent call last): [ 887.189805] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 887.189805] env[68828]: return func(*args, **kwargs) [ 887.189805] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 887.189805] env[68828]: res.raise_for_status() [ 887.189805] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 887.189805] env[68828]: raise HTTPError(http_error_msg, response=self) [ 887.189805] env[68828]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/99081680-ef28-4c21-a011-b835eb2d3904 [ 887.189805] env[68828]: During handling of the above exception, another exception occurred: [ 887.189805] env[68828]: Traceback (most recent call last): [ 887.190036] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 887.190036] env[68828]: listener.cb(fileno) [ 887.190036] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 887.190036] env[68828]: result = function(*args, **kwargs) [ 887.190036] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 887.190036] env[68828]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 887.190036] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 887.190036] env[68828]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 887.190036] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 887.190036] env[68828]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 887.190036] env[68828]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 887.190036] env[68828]: res.raise_for_status() [ 887.190036] env[68828]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 887.190036] env[68828]: raise HTTPError(http_error_msg, response=self) [ 887.190036] env[68828]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/99081680-ef28-4c21-a011-b835eb2d3904 [ 887.190036] env[68828]: Removing descriptor: 15 [ 887.595066] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 887.595279] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 deletion is rescheduled due to dependency. [ 887.595380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.595546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.595756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.595938] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.596085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.596151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.596309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.596391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.596485] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.611956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.612107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.612175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.612387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.612561] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.612662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.612726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.612867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.612980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.613041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.613181] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.613274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.613336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.613471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.613603] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.613692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.613751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.613881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.613953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.614046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.614135] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.926471] env[68828]: INFO networking_nsxv3.common.synchronization [req-5b9fabe5-4323-4c60-9860-595a12356cdd req-988d612f-46c3-4e13-b597-04f401b7e5e1 tempest-MigrationsAdminTest-1798027422 tempest-MigrationsAdminTest-1798027422-project-member] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 887.926853] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 887.927170] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.927317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.927371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.927540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.927685] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.927791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.927851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.927995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.928077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.928154] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.098698] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.099033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.099033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.099157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.116494] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 309bda50-1db3-47e1-b12b-431331217ccd: rpc.has_security_group_logging(os_id): False [ 888.119927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.120226] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.120380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.120466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.120684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.120786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.120893] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be updated. [ 888.135224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.138103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.138103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.138103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.150424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.150601] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.150671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.150829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.150963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.155559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.155782] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.155893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.155958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.156635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.156635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.156635] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.156635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.156635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.156871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.156871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.156966] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.157069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.157125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.157270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.157338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.157419] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 888.159258] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: IN_PROGRESS for 2s [ 888.222933] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.223109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.223201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.223498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.223571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.247294] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 888.360725] env[68828]: INFO networking_nsxv3.common.synchronization [req-f1b46c7f-1ec9-40cb-9d9f-5d95f610ba4f req-253becbb-8be7-4c67-b178-5ed5c31a23f1 tempest-InstanceActionsV221TestJSON-1495538254 tempest-InstanceActionsV221TestJSON-1495538254-project-member] Enqueued Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_members [ 888.360902] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_members [ 888.361220] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.361335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.361536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.361643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.361799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.361897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.362000] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.362177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.362348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.362432] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.430093] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.593893] env[68828]: INFO networking_nsxv3.common.synchronization [req-b7396fd6-bbd9-4891-8aa0-0f7f9c9c3732 req-6193cc58-1d33-412d-9062-5faef2313f93 tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 888.593893] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 888.596069] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.596240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.596309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.596523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.597217] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.597217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.597217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.597379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.597463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.598365] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.612672] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 888.612921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.614362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.614362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.614362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.614362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.614362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.614362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.614362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.615331] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.677283] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.677422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-389" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.677530] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-389" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.677866] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-389" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.678153] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.678323] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.678446] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.678666] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.678813] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.679037] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.679158] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.679270] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.679385] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.679498] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.679607] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.679742] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.697330] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.697517] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.697662] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.697844] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-389" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.698187] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-cf122b60-89c4-44f1-85e2-63ac30e891b7 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.698544] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.698544] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.698792] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.698938] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf122b60-89c4-44f1-85e2-63ac30e891b7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.865162] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.865500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.865643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.865895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.866895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.866895] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.866895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.866895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.866895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.866895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.866895] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42ac7969-2394-41c5-ac03-dedae73eb17f already deleted. [ 888.866895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.933630] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.101780] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.119611] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.200993] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.201278] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.201415] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.201705] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.201862] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.202040] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port cf122b60-89c4-44f1-85e2-63ac30e891b7 not found, creating... [ 889.202399] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.202577] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.202700] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.202930] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.203086] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.203399] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.203572] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.203698] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.203952] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.204110] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.204261] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: cf122b60-89c4-44f1-85e2-63ac30e891b7 is going to be created. [ 889.223358] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.223551] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.223686] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.223945] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.224195] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.224429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.435712] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.435876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.435951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.436162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.436248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.436373] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be updated. [ 889.466532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.466724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.466724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.466956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.467123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.487252] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 889.606906] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.622510] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.911720] env[68828]: INFO networking_nsxv3.common.synchronization [req-f1b46c7f-1ec9-40cb-9d9f-5d95f610ba4f req-3624ae14-57a6-4cc8-b333-c13c6eeab86f service nova] Enqueued Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_rules [ 889.911720] env[68828]: INFO networking_nsxv3.common.synchronization [req-f1b46c7f-1ec9-40cb-9d9f-5d95f610ba4f req-3624ae14-57a6-4cc8-b333-c13c6eeab86f service nova] Enqueued Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_members [ 889.911720] env[68828]: INFO networking_nsxv3.common.synchronization [req-f1b46c7f-1ec9-40cb-9d9f-5d95f610ba4f req-3624ae14-57a6-4cc8-b333-c13c6eeab86f service nova] Enqueued Resource ID: cf122b60-89c4-44f1-85e2-63ac30e891b7 with Priority: HIGHEST for action port [ 889.911832] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_rules [ 889.911861] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_members [ 889.911949] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf122b60-89c4-44f1-85e2-63ac30e891b7 with Priority: HIGHEST for action port [ 889.912538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.912651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.912712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.913018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.913071] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.913831] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.913934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.913992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.914169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.914309] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.914402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.914460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.914619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.914699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.914783] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.915923] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf122b60-89c4-44f1-85e2-63ac30e891b7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.916057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.916123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.916238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.916317] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf122b60-89c4-44f1-85e2-63ac30e891b7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.108956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.108956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.108956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.109618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.109618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.109618] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 890.125264] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.125428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.125502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.125776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.125834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.125937] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 890.138459] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.138642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.138642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.138811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.138956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.146202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 890.155834] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.156029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.156097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.156302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.156795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.166524] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 890.166695] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 deletion is rescheduled due to dependency. [ 890.166813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.166962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167352] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.167456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.167511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167946] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.169686] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 890.262202] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 890.262487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.417885] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.417962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.418141] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf122b60-89c4-44f1-85e2-63ac30e891b7 with status ACTIVE [ 890.418312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.418422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.418487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.418694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.418785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.418989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.419062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.419124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.419278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.419375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.419583] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.419664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.419692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.419834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.419907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.419989] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf122b60-89c4-44f1-85e2-63ac30e891b7 is going to be updated. [ 890.421052] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.440695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.440822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.440891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.441109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.441242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.441398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf122b60-89c4-44f1-85e2-63ac30e891b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.670551] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.887441] env[68828]: INFO networking_nsxv3.common.synchronization [req-47205130-5628-4b43-91cf-7cfbd3204622 req-a5878d7e-2591-43a1-949f-14304031e29d tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 890.887960] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 890.888286] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.888429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.888467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.888669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.888823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.888907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.888974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.889132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.889222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.889317] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.925341] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.173154] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0772c5f0-7902-49dd-8073-f3ce338b4a68: rpc.has_security_group_logging(os_id): False [ 891.210404] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.210619] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.210753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.211039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.211302] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.211467] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.211591] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.211856] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.211955] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.212447] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.212577] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.212696] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.213380] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.213380] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.213380] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.213380] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.233682] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.233829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.233895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.234111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.234204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.234438] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.234545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.234621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.234773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.234850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.234940] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be updated. [ 891.241760] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.241760] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.241875] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.242034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.243664] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-7178770a-248b-4e52-833b-3ab4b077e3fb taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.243664] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.243664] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.243664] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.243664] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7178770a-248b-4e52-833b-3ab4b077e3fb',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.289809] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.289809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.289809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.289809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.289809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.302966] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: IN_PROGRESS for 2s [ 891.393257] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.427727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.427727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.427727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.427941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.428030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.428128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42ac7969-2394-41c5-ac03-dedae73eb17f is going to be created. [ 891.451596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.451852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.451852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.451994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.452165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.461338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42ac7969-2394-41c5-ac03-dedae73eb17f in Status: UNINITIALIZED for 2s [ 891.494448] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 891.494715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.748688] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.750166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.750166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.750166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.750166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.750166] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 7178770a-248b-4e52-833b-3ab4b077e3fb not found, creating... [ 891.750392] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.750464] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.751033] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.751033] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.751033] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.751193] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.751356] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.751481] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.751694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.751833] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.751979] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 7178770a-248b-4e52-833b-3ab4b077e3fb is going to be created. [ 891.791034] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.791034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.791214] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.791450] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.791674] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.791904] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.896635] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.158036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 892.158036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.178170] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 892.178455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.178572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.178766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.179347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.179479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.179566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.179752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.179839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.179952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.180079] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.398354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.398512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.398592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.398799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.398889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.398995] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 892.428071] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.428222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.428307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.428488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.428627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.436192] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 892.472635] env[68828]: INFO networking_nsxv3.common.synchronization [req-47205130-5628-4b43-91cf-7cfbd3204622 req-f46787d9-698e-4c92-8910-e77c8b7f3d7f service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 892.472812] env[68828]: INFO networking_nsxv3.common.synchronization [req-47205130-5628-4b43-91cf-7cfbd3204622 req-f46787d9-698e-4c92-8910-e77c8b7f3d7f service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 892.472957] env[68828]: INFO networking_nsxv3.common.synchronization [req-47205130-5628-4b43-91cf-7cfbd3204622 req-f46787d9-698e-4c92-8910-e77c8b7f3d7f service nova] Enqueued Resource ID: 7178770a-248b-4e52-833b-3ab4b077e3fb with Priority: HIGHEST for action port [ 892.473197] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 892.473328] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 892.473424] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7178770a-248b-4e52-833b-3ab4b077e3fb with Priority: HIGHEST for action port [ 892.473966] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.474198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.474308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.474541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.474709] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.475586] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.475683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.475911] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-7178770a-248b-4e52-833b-3ab4b077e3fb taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.476122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.476122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.476334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.476438] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7178770a-248b-4e52-833b-3ab4b077e3fb',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.686030] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.686030] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.686030] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.686030] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.686030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.686816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.686816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.686816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.686816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.686816] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.980349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.980349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.980627] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7178770a-248b-4e52-833b-3ab4b077e3fb with status ACTIVE [ 892.980627] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.980751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.980799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.980990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.981097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.981295] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.981380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.981428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.981691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.981691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.981816] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.981898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.981951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.982134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.982230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.982342] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7178770a-248b-4e52-833b-3ab4b077e3fb is going to be updated. [ 893.005255] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.005470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.005470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.005740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.005808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.006074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7178770a-248b-4e52-833b-3ab4b077e3fb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.188656] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9050286-eb81-4cbb-9bd8-733baee0e20c: rpc.has_security_group_logging(os_id): False [ 893.207703] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.207844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.207917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.208151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.228270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.228408] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.228551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.228581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.228765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.228849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.229072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.229195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.229233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.229378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.229489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.229651] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.229748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.229802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.229941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.230026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.230112] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 893.293808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.293962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.294047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.294265] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.294439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.313170] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 893.313833] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 in Status: SUCCESS [ 893.314080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.472589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42ac7969-2394-41c5-ac03-dedae73eb17f in Status: SUCCESS [ 893.472856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.472973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.473211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.473432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.473552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.473618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.473773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.473853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.473937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.474039] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.551986] env[68828]: INFO networking_nsxv3.common.synchronization [req-8a6c4efb-386e-4c34-aa7b-235d9fcee6e7 req-6438400a-8b00-4b6f-8356-ce9a1ba74b33 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 893.552560] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 893.552853] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.552974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.553079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.553304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.553528] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.553660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.553729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.553892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.553975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.554080] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.976589] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.976815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.976868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.977926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.978256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.978256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.979022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.979022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.979022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.979022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.979022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.979022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.979208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.979238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.979969] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.979969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.979969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.979969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.979969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.979969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.980437] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.055895] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.056106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.056106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.056331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.080467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.080751] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.080863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.080920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.081106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.081203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.081280] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 894.109025] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.109025] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.109025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.109025] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.109025] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.109025] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.109025] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.109766] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.109766] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.109766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.113394] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.113534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.113534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.114413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.114413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.126186] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 894.136404] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.136876] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.137330] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.138315] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.138315] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-742964f7-59e1-49da-9a96-2133dd4d775e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.138315] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.138621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.138682] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.140052] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742964f7-59e1-49da-9a96-2133dd4d775e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.447735] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.447735] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.447735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.447735] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.483032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42ac7969-2394-41c5-ac03-dedae73eb17f: rpc.has_security_group_logging(os_id): False [ 894.502060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.502060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.502060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.502060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.505201] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.505201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.505201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.505201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.505201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.505201] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42ac7969-2394-41c5-ac03-dedae73eb17f is going to be created. [ 894.562356] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.562356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.562356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.562356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.562836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.573762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42ac7969-2394-41c5-ac03-dedae73eb17f in Status: IN_PROGRESS for 2s [ 894.643615] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.643845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.644090] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.644459] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.644623] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.644782] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 742964f7-59e1-49da-9a96-2133dd4d775e not found, creating... [ 894.645065] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.645228] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.645369] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.645596] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.645733] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.646072] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.646172] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.646290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.646495] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.647156] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.647316] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 742964f7-59e1-49da-9a96-2133dd4d775e is going to be created. [ 894.675634] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.678380] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.678560] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.678884] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.679158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.679408] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.699816] env[68828]: INFO networking_nsxv3.common.synchronization [req-d12e3d9f-ce68-4f11-9672-625adc8cf3a9 req-b9eb233b-2e9e-4334-a17b-0e47927c8fc5 tempest-ListServerFiltersTestJSON-1826443975 tempest-ListServerFiltersTestJSON-1826443975-project-member] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 894.699816] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 894.699981] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.700113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.700231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.700376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.700528] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.700619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.700674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.700815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.701968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.702083] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.954072] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.204479] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.334046] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 895.334280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.461404] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.506474] env[68828]: INFO networking_nsxv3.common.synchronization [req-8a6c4efb-386e-4c34-aa7b-235d9fcee6e7 req-176d4c75-4a88-4ffc-be0d-8ed679eb3db3 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 895.506690] env[68828]: INFO networking_nsxv3.common.synchronization [req-8a6c4efb-386e-4c34-aa7b-235d9fcee6e7 req-176d4c75-4a88-4ffc-be0d-8ed679eb3db3 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 895.506861] env[68828]: INFO networking_nsxv3.common.synchronization [req-8a6c4efb-386e-4c34-aa7b-235d9fcee6e7 req-176d4c75-4a88-4ffc-be0d-8ed679eb3db3 service nova] Enqueued Resource ID: 742964f7-59e1-49da-9a96-2133dd4d775e with Priority: HIGHEST for action port [ 895.507510] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 895.507654] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 895.507751] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 742964f7-59e1-49da-9a96-2133dd4d775e with Priority: HIGHEST for action port [ 895.508050] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.508183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.508245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.508466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.508828] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.509429] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.509553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.509769] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-742964f7-59e1-49da-9a96-2133dd4d775e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.509867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.509933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.510120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.510201] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742964f7-59e1-49da-9a96-2133dd4d775e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.710317] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.968639] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.968639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.968639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.968639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.968639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.968639] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 895.993834] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.993834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.993834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.993834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.993834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.000681] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 896.016021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.016021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 742964f7-59e1-49da-9a96-2133dd4d775e with status ACTIVE [ 896.016021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.016021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.016021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.016021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.016650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.016650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.016650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.016650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.016650] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 742964f7-59e1-49da-9a96-2133dd4d775e is going to be updated. [ 896.034791] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.035367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.035578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.035888] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.036159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.036457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-742964f7-59e1-49da-9a96-2133dd4d775e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.134963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 896.137695] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.137695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.137695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.137695] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.215128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.215128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.215128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.215128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.215128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.215128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 896.242129] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.242129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.242129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.242129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.242129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.250379] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 896.513616] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-de25d301-94be-4311-989b-e87bea70f99f tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 896.514334] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 896.514515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.514673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.514751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.515017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.515203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.515310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.515371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.515520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.515614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.515706] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.587631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42ac7969-2394-41c5-ac03-dedae73eb17f in Status: SUCCESS [ 896.587865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.641551] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.950403] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-8274acdc-90cd-418e-93a4-3ef56e9ddb2d tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 896.951166] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 896.951817] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.951817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.017695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.017876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.017947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.018173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.018262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.018640] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.018640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.018640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.018956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.018956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.018956] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 already deleted. [ 897.018956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.019530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.019685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.019836] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.019934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.019990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.020182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.020292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.020385] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.142692] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.337885] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-8401d55a-3916-40ce-a4e5-b11b82044a5d tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 897.338441] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 897.338824] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.338927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.525895] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.525895] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.525895] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 already deleted. [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.525895] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.525895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.526723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.526723] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.647135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.647207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.647283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.647493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.647574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.648076] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 897.673769] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.673917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.673988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.674211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.674371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.682717] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 897.870157] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.870399] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.870540] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.870872] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.871166] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.871330] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.871936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.871936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.871936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.872299] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.872299] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.872299] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.872400] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.872594] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.872660] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.873536] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.902101] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.902377] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 897.902571] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.902705] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.903037] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-bc5218b5-bff0-4c65-a356-562c4e186d6f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.903220] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.903347] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.903679] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.903828] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc5218b5-bff0-4c65-a356-562c4e186d6f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.014465] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 898.014734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.014930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.015677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.015677] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.015677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.015677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.015966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.015966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.016042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.016868] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.031234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.031453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.031522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.031691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.031809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.032040] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.032154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.032232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.032499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.032588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.032695] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 already deleted. [ 898.032790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.263458] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 898.263458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.410811] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.410811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.410811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.410811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.410811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.411148] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port bc5218b5-bff0-4c65-a356-562c4e186d6f not found, creating... [ 898.411313] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.411546] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.411705] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.411961] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.412160] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.412571] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.412785] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.412941] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.413212] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.413413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.413605] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: bc5218b5-bff0-4c65-a356-562c4e186d6f is going to be created. [ 898.431846] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.432049] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.432186] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.432505] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.432731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.432956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.518642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.518765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.518859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.519079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.519257] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.519360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.519420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.519571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.519659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.519746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.519889] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.520253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.520253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.520253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.520434] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.520528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.520583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.520723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.520795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.520877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.521012] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.025659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 899.042042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.042797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.042797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.042797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.061489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.061489] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.061489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.061489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.061781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.061781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.061839] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.061882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.061976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.062107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.062169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.062514] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.062514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.062514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.062682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.062735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.062800] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 899.120504] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.120686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.120779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.121036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.121195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.133698] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 899.310692] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-cd7774f6-5434-4e16-8d4a-b9c453d15c0d service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 899.310926] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-cd7774f6-5434-4e16-8d4a-b9c453d15c0d service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 899.311125] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-cd7774f6-5434-4e16-8d4a-b9c453d15c0d service nova] Enqueued Resource ID: bc5218b5-bff0-4c65-a356-562c4e186d6f with Priority: HIGHEST for action port [ 899.311783] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 899.311863] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 899.311984] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5218b5-bff0-4c65-a356-562c4e186d6f with Priority: HIGHEST for action port [ 899.312522] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.312687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.312764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.313097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.313344] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.314142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.314269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.314339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.314521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.314686] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.314755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.314817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.316329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.316455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.316596] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.317432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc5218b5-bff0-4c65-a356-562c4e186d6f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.317548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.317618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.317807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.317885] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc5218b5-bff0-4c65-a356-562c4e186d6f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.693531] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.693531] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.693531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.693827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.693827] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.823021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.823021] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.823021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc5218b5-bff0-4c65-a356-562c4e186d6f with status ACTIVE [ 899.823021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.823021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.823021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.823750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.823750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.823750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.823750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.823750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.823750] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc5218b5-bff0-4c65-a356-562c4e186d6f is going to be updated. [ 899.846067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.846504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.846682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.846980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.847230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.847483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc5218b5-bff0-4c65-a356-562c4e186d6f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.972178] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-a129d9c0-3c64-4926-9dfd-76646608ef32 tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 899.972178] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 899.972178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.972178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.972178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.972679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.972995] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.973494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.973667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.974033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.974226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.974451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.196113] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.196424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.196424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.196627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.196714] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.196808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.196868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.197020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.197551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.197667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.197898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.198012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.198081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.198227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.198365] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.198836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.198921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.200340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.200340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.200340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.200340] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.224428] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.224428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-78" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.224428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-78" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.224428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-78" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.224428] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.224428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.224428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.224428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.224841] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.225624] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.225751] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.225874] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.225993] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.226125] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.226240] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.226390] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.247709] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.247896] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.248061] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.248260] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-78" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.248591] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-faecd4c2-5074-4972-97ec-c32f1305f9fe taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.248754] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.248881] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.249247] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.249711] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faecd4c2-5074-4972-97ec-c32f1305f9fe',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.330302] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.479761] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.479916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.479976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.480216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.480334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.483021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.483021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.483021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.483021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.483021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.483021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 already deleted. [ 900.483021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.496140] env[68828]: INFO networking_nsxv3.common.synchronization [req-a14b3c16-4606-45e9-a212-cf9158132a02 req-b3e6c192-d2e7-456d-8abb-51f67d9f7f33 tempest-InstanceActionsV221TestJSON-1495538254 tempest-InstanceActionsV221TestJSON-1495538254-project-member] Enqueued Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_members [ 900.496718] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGHEST for action security_group_members [ 900.496889] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.497038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.497228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.497510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.497510] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.497510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.499234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.499234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.499234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.499234] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.636012] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-610 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.636012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.636012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.636012] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.636220] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.636320] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.636425] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.637723] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.637723] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.637723] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.637723] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.637723] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.637723] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.637723] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.637723] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.638047] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.655219] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.655388] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.655531] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.655768] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.656110] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-107cbcff-904a-4455-8dfd-fe36654f190e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.656294] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.656418] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.656737] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.656862] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107cbcff-904a-4455-8dfd-fe36654f190e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.701759] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fdb4832-fb6b-46dc-9929-5e545ccfc219: rpc.has_security_group_logging(os_id): False [ 900.729798] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.730056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.730056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.730993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.730993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.730993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.730993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.730993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.731291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.731291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.731478] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.731587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.731651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.731799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.731893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.732059] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.732157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.732217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.732431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.732510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.732598] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 900.752125] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.752559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.752559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.752843] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.752992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.753763] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port faecd4c2-5074-4972-97ec-c32f1305f9fe not found, creating... [ 900.754550] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.754550] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.754550] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.754550] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.754762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.754931] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.755107] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.755290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.755554] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.755706] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.755902] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: faecd4c2-5074-4972-97ec-c32f1305f9fe is going to be created. [ 900.795901] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.796148] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.796283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.796559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.796787] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.797026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.811897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.811897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.811897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.811897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.811897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.832534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.832697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.832745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.832992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.833153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.833261] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be created. [ 900.834983] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 900.894663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.894822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.894894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.895119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.895273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.941017] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: UNINITIALIZED for 2s [ 901.001854] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.002045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.002202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.002443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.002588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.002962] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.002962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.003092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.003190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.003276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.003379] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42ac7969-2394-41c5-ac03-dedae73eb17f is going to be updated. [ 901.032897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.033050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.033050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.033448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.033448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.041324] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42ac7969-2394-41c5-ac03-dedae73eb17f in Status: IN_PROGRESS for 2s [ 901.159616] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 901.159864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.160437] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.160645] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.160774] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.161060] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.161211] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.161626] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 107cbcff-904a-4455-8dfd-fe36654f190e not found, creating... [ 901.161941] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.162085] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.162200] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.162520] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.162662] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.163413] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.163413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.163413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.163585] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.163740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.163925] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 107cbcff-904a-4455-8dfd-fe36654f190e is going to be created. [ 901.185699] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.185845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.185953] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.186262] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.186765] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.186765] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.472092] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-8fa8c57f-fc4e-4fd5-9f5b-9fa56fd52493 service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 901.472377] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-8fa8c57f-fc4e-4fd5-9f5b-9fa56fd52493 service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 901.472480] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-8fa8c57f-fc4e-4fd5-9f5b-9fa56fd52493 service nova] Enqueued Resource ID: faecd4c2-5074-4972-97ec-c32f1305f9fe with Priority: HIGHEST for action port [ 901.472711] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 901.472932] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 901.472932] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faecd4c2-5074-4972-97ec-c32f1305f9fe with Priority: HIGHEST for action port [ 901.473474] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.473565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.473851] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.473851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.474025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-faecd4c2-5074-4972-97ec-c32f1305f9fe taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.474114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.474174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.474555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.474555] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faecd4c2-5074-4972-97ec-c32f1305f9fe',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.975990] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faecd4c2-5074-4972-97ec-c32f1305f9fe with status ACTIVE [ 901.976265] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.976435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.979325] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.979325] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.979325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.979325] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faecd4c2-5074-4972-97ec-c32f1305f9fe is going to be updated. [ 901.999117] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.999117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.999117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.999117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.999117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.999117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faecd4c2-5074-4972-97ec-c32f1305f9fe" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.287518] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.287781] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.287981] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.288330] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.288683] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.288895] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.289161] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.289568] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.289822] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.290136] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.290366] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.290560] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.290741] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.290956] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.291159] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.291402] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.310976] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.310976] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.310976] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.310976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-578" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.310976] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-6d374c74-46ec-4844-8836-57065e1e96b1 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.311517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.311517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.311739] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.311919] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d374c74-46ec-4844-8836-57065e1e96b1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.802903] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-23fa66dd-e6ef-41e0-b7ad-bba8d85eea4f service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 902.802903] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-23fa66dd-e6ef-41e0-b7ad-bba8d85eea4f service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 902.802903] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-23fa66dd-e6ef-41e0-b7ad-bba8d85eea4f service nova] Enqueued Resource ID: 107cbcff-904a-4455-8dfd-fe36654f190e with Priority: HIGHEST for action port [ 902.803836] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 902.804017] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 902.804154] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107cbcff-904a-4455-8dfd-fe36654f190e with Priority: HIGHEST for action port [ 902.805117] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.805117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.805117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.805608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.805608] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.806680] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.806680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.806680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.806811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.806906] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.807051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.807822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.807822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.807822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.807822] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.808392] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-107cbcff-904a-4455-8dfd-fe36654f190e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.808530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.808617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.808803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.808913] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107cbcff-904a-4455-8dfd-fe36654f190e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.816527] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.816725] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.816856] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.817114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.817268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.817422] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 6d374c74-46ec-4844-8836-57065e1e96b1 not found, creating... [ 902.817677] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.817836] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.817957] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.818193] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.818336] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.818615] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.818774] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.818894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.819121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.819262] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.819404] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 6d374c74-46ec-4844-8836-57065e1e96b1 is going to be created. [ 902.840227] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.840449] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840577] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840853] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.841830] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841830] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.848938] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 902.849174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.951878] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 902.952168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.952338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.952605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.952838] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.952967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.953134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.953983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.953983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.953983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.953983] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.955614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.955614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.956048] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.956246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.956317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.956563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.956678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.956793] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.035146] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-6d5f1713-d694-464a-9141-16baa4da36af tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 903.035684] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 903.040198] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.040198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.053534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42ac7969-2394-41c5-ac03-dedae73eb17f in Status: SUCCESS [ 903.053716] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42ac7969-2394-41c5-ac03-dedae73eb17f deletion is rescheduled due to dependency. [ 903.053832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.311129] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.311261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.311435] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.312232] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 107cbcff-904a-4455-8dfd-fe36654f190e with status ACTIVE [ 903.312471] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.312605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.312676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.312876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.312963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.313151] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.313247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.313312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.313458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.313538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.313728] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.313804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.313857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.313992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.314157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.314244] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 107cbcff-904a-4455-8dfd-fe36654f190e is going to be updated. [ 903.332967] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.333120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.333192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.333421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.333564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.333720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-107cbcff-904a-4455-8dfd-fe36654f190e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.439190] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-610 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.439439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.439577] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.439850] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.440187] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.440293] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.440402] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.440616] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.440765] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.441056] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.441321] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.441491] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.441770] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.441860] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.441979] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.442135] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.459850] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.459986] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.460241] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.460335] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.460625] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-1666c3b9-3b43-4831-9303-950ec5c2bc2c taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.460789] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.460911] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.461258] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.461399] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1666c3b9-3b43-4831-9303-950ec5c2bc2c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.462411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.462411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.462566] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.581536] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-9a3a5d19-5673-49f2-84db-002bd1df2429 service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 903.581811] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-9a3a5d19-5673-49f2-84db-002bd1df2429 service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 903.582011] env[68828]: INFO networking_nsxv3.common.synchronization [req-4f4de3df-31a8-4115-89a2-9104162a2b47 req-9a3a5d19-5673-49f2-84db-002bd1df2429 service nova] Enqueued Resource ID: 6d374c74-46ec-4844-8836-57065e1e96b1 with Priority: HIGHEST for action port [ 903.582532] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 903.582697] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 903.582808] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d374c74-46ec-4844-8836-57065e1e96b1 with Priority: HIGHEST for action port [ 903.589362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.589362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.589362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.589362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.589362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d374c74-46ec-4844-8836-57065e1e96b1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.589362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.589362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.589362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.589362] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d374c74-46ec-4844-8836-57065e1e96b1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.816388] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.833554] env[68828]: INFO networking_nsxv3.common.synchronization [req-f45b89d0-67c3-433a-b290-4b7b57301a3a req-083c5102-2150-4294-9a67-49bf8c5b584a tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 903.833554] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 903.833800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.833925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.833992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.834250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.834443] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.834577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.834683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.834877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.834998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.835127] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.964989] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.965901] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.966058] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.966353] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.966515] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.966683] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 1666c3b9-3b43-4831-9303-950ec5c2bc2c not found, creating... [ 903.966957] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.967141] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.967273] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.967500] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.967647] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.969123] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.969273] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.969950] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.971024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.971024] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.971024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 1666c3b9-3b43-4831-9303-950ec5c2bc2c is going to be created. [ 903.972358] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.992603] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.992811] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.992943] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.993233] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.993488] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.993717] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.093688] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d374c74-46ec-4844-8836-57065e1e96b1 with status ACTIVE [ 904.093922] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.094089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.094163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.094372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.094464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.094664] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.094766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.094827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.094975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.095067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.095247] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.095339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.095402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.095543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.095617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.095703] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d374c74-46ec-4844-8836-57065e1e96b1 is going to be updated. [ 904.114421] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.114543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.114613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.114796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.114922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.115100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d374c74-46ec-4844-8836-57065e1e96b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.320086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.320246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.320326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.320565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.320660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.320760] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be created. [ 904.336851] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.343334] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.343475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.343553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.343762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.343918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.351846] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: UNINITIALIZED for 2s [ 904.478467] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.478671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.478728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.478904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.479197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.479197] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 904.504961] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.505191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.505311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.505628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.505849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.514217] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 904.839315] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.928668] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-51183efb-b206-4d34-98cb-5cfcf6239438 service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 904.928861] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-51183efb-b206-4d34-98cb-5cfcf6239438 service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 904.929014] env[68828]: INFO networking_nsxv3.common.synchronization [req-6a2a0c7a-3d3c-4ed6-a094-ae0fbd3af005 req-51183efb-b206-4d34-98cb-5cfcf6239438 service nova] Enqueued Resource ID: 1666c3b9-3b43-4831-9303-950ec5c2bc2c with Priority: HIGHEST for action port [ 904.929493] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 904.929627] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 904.929716] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1666c3b9-3b43-4831-9303-950ec5c2bc2c with Priority: HIGHEST for action port [ 904.929982] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.930467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.930754] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.930852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.931053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1666c3b9-3b43-4831-9303-950ec5c2bc2c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.931162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.931224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.931602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.931687] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1666c3b9-3b43-4831-9303-950ec5c2bc2c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.350108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.350108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.350108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.350108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.350108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.350108] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 905.377920] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.378120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.378298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.378364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.378495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.390012] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 905.436419] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1666c3b9-3b43-4831-9303-950ec5c2bc2c with status ACTIVE [ 905.436693] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.436868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.436954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.437219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.437329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.437584] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.437670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.437751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.437913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.437994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.438224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.438384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.438433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.438557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.438660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.438748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1666c3b9-3b43-4831-9303-950ec5c2bc2c is going to be updated. [ 905.457976] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.458167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.458274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.458522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.458684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.458882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1666c3b9-3b43-4831-9303-950ec5c2bc2c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.361767] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 906.362069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.362212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.362469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.362606] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.362714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.362783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.362935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.363044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.363152] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.524074] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 906.524795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.524795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.525024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.525055] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.525836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.525836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.525836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.525836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.525836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.525836] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.526165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.526165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.526165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.526242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.526858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.526952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.527553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.527553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.527553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.527553] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.528258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.528857] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.528857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.528857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.528857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.529397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.529397] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.865669] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.032702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e73ec652-3cf2-4f74-85a7-b281cb693a56: rpc.has_security_group_logging(os_id): False [ 907.033735] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.053368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.053555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.053596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.053858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.053974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.054213] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.056128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.056128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.056128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.056128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be created. [ 907.115216] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.115444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.115497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.116579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.116579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.130601] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 907.368610] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.395623] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 907.395918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.537942] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.728151] env[68828]: INFO networking_nsxv3.common.synchronization [req-c64b8c8c-cc97-49c9-a5b0-8acf86190545 req-2de37e61-b650-4cfc-8c31-ee89c686726a tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_members [ 907.728657] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_members [ 907.729007] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.729105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.729212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.729403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.729545] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.729636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.729691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.729838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.729922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.731051] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.870548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.870713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.870846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.871247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.871392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.871543] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 907.914993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.915156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.915267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.915453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.915667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.925171] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 908.040546] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.040759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.040880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.041197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.041334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.041472] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 908.058308] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.058649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.058863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.059729] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.060088] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.060088] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.060224] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.060732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.060732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.061154] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.061154] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.061242] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.061644] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.061644] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.061644] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.061778] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.069110] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.069262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.069322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.069514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.069673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.077282] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 908.078242] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.078472] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.078710] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.079019] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.079390] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.079688] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.079916] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.080598] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.080693] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6718cfd6-0184-45c0-9d8c-0c61bcd8f558',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.174927] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ec00bef3-b2ef-4892-b69a-167c7fe1fca5 tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 with Priority: HIGHEST for action security_group_rules [ 908.176338] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 with Priority: HIGHEST for action security_group_rules [ 908.176770] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.176958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.176958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.177476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.177741] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6fb2d4-0e0e-46a1-89d5-22214803a0c6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.234942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.235137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.235355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.235467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.235549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.235752] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.236103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.236103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.236103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.238869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.238869] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 already deleted. [ 908.238869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.263867] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ce6bff60-4f3c-46dc-b804-7fe3bbd7872d tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 with Priority: HIGHEST for action security_group_rules [ 908.265745] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 with Priority: HIGHEST for action security_group_rules [ 908.266458] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.266458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.583757] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.584245] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.584245] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.584428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.584554] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.584732] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 6718cfd6-0184-45c0-9d8c-0c61bcd8f558 not found, creating... [ 908.585031] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.585199] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.585320] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.585590] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.585761] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.586118] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.586301] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.586431] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.586806] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.586992] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.587160] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 6718cfd6-0184-45c0-9d8c-0c61bcd8f558 is going to be created. [ 908.607818] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.608070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.608292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.608632] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.608872] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.609140] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.704223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.704451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.704451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.704782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.704890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.704970] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 already deleted. [ 908.705064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.705223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.705391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.705479] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6fb2d4-0e0e-46a1-89d5-22214803a0c6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.141476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 909.141703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.141886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.142123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.142212] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.226866] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.227054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.227291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.227437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.227437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.227527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6fb2d4-0e0e-46a1-89d5-22214803a0c6 already deleted. [ 909.227588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6fb2d4-0e0e-46a1-89d5-22214803a0c6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.374736] env[68828]: INFO networking_nsxv3.common.synchronization [req-c64b8c8c-cc97-49c9-a5b0-8acf86190545 req-6f43292e-0993-4384-a1d0-5f29b5d61efd service nova] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_rules [ 909.375034] env[68828]: INFO networking_nsxv3.common.synchronization [req-c64b8c8c-cc97-49c9-a5b0-8acf86190545 req-6f43292e-0993-4384-a1d0-5f29b5d61efd service nova] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_members [ 909.375431] env[68828]: INFO networking_nsxv3.common.synchronization [req-c64b8c8c-cc97-49c9-a5b0-8acf86190545 req-6f43292e-0993-4384-a1d0-5f29b5d61efd service nova] Enqueued Resource ID: 6718cfd6-0184-45c0-9d8c-0c61bcd8f558 with Priority: HIGHEST for action port [ 909.376018] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_rules [ 909.376264] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_members [ 909.376356] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6718cfd6-0184-45c0-9d8c-0c61bcd8f558 with Priority: HIGHEST for action port [ 909.376954] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.377589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.378220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.378800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.378969] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.381041] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.381163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.381257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.381832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.381832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.381832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.382133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.382301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.382406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.382619] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.384916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.385517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.385732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.386062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.386220] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6718cfd6-0184-45c0-9d8c-0c61bcd8f558',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.648507] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.648843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.882552] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.882687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.889152] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.894555] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6718cfd6-0184-45c0-9d8c-0c61bcd8f558 with status ACTIVE [ 909.894783] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.894924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.895009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.895255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.895367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.895572] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.895705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.895775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.895928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.896029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.898532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.898532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.898532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.898532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.898532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.898532] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6718cfd6-0184-45c0-9d8c-0c61bcd8f558 is going to be updated. [ 909.918594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.918594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.918594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.918594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.918594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.918594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6718cfd6-0184-45c0-9d8c-0c61bcd8f558" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.947032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.947032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.947032] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.947032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.947032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.947860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.948066] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.089233] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 910.089233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.089233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.089233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.089233] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.089233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.089233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.089542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.089542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.089598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.089673] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.395260] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.452530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.452693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.453289] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.592155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.592155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.592155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.592155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.592350] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.592507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.592567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.592718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.592798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.592884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.593038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.593129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.593187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.593321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.593471] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.593559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.593615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.593746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.593814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.593891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.593978] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.898193] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.898525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.898525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.898838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.898973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.899876] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 is going to be created. [ 910.927643] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.927643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.927643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.928317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.928317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.938428] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 in Status: UNINITIALIZED for 2s [ 910.959105] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.098386] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e73ec652-3cf2-4f74-85a7-b281cb693a56: rpc.has_security_group_logging(os_id): False [ 911.132207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.132465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.132465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.133062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.133062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.133062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.133466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.133466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.133466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.133466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.133665] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.133770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.133832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.133976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.134267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.134532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.134647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.134722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.134870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.134946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.135046] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 911.219019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.219019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.219019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.219019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.219019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.229359] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 911.463460] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.463460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.463460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.463460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.463460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.463460] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 911.495029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.495029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.495029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.495029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.495029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.506483] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 912.236455] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7d7a1373-877d-412c-a8b5-b25773287e22 None None] Enqueued Resource ID: 27d92fa4-6549-47e7-830e-68c320480e44 with Priority: HIGHEST for action port [ 912.236693] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27d92fa4-6549-47e7-830e-68c320480e44 with Priority: HIGHEST for action port [ 912.237957] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-27d92fa4-6549-47e7-830e-68c320480e44 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.237957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27d92fa4-6549-47e7-830e-68c320480e44" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.237957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27d92fa4-6549-47e7-830e-68c320480e44" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.237957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27d92fa4-6549-47e7-830e-68c320480e44" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.237957] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27d92fa4-6549-47e7-830e-68c320480e44',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.744331] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27d92fa4-6549-47e7-830e-68c320480e44 [ 912.744567] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.744788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.744883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.745086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.745226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.745327] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27d92fa4-6549-47e7-830e-68c320480e44 already deleted. [ 912.745413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27d92fa4-6549-47e7-830e-68c320480e44" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.951148] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 in Status: SUCCESS [ 912.951434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.951717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.951962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.952237] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.952480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.952653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.952780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.954855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.954855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.954855] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.244020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 913.246161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.246161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.246161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.246161] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.458871] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.515510] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 913.515748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.516806] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.516806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.517191] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.517191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.517191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.517292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.517363] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.517454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.517514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.517649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.517724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.517822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.517883] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.748056] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.748227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.748298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.748511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.748727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.748893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.748947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.749097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.749185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.749272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.749362] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.962923] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3520fd5-ed17-4f2b-837a-d2cb4c3d0573: rpc.has_security_group_logging(os_id): False [ 913.981024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.981024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.981024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.981024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.981024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.981024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.981954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.982233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.982627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.982891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.983168] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 is going to be created. [ 914.020707] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826410a3-2e17-4f39-bb2e-9ab8ef871c84: rpc.has_security_group_logging(os_id): False [ 914.038025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.038025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.038025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.038025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.038025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.038678] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.038914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.039079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.039327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.039516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.039801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.040025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.040176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.040401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.040566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.040825] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.041036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.041185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.041400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.041581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.041844] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.042066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.042212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.042466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.042643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.042810] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be created. [ 914.051749] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 in Status: IN_PROGRESS for 2s [ 914.105998] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.106262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.106262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.106512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.106756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.119566] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 914.175133] env[68828]: INFO networking_nsxv3.common.synchronization [req-19dd11b0-a6fa-4596-9a8a-ecd945291f24 req-bd23044b-78bc-4179-ad4e-352f96796107 tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: afd9f990-743b-48e3-b661-540270d91f26 with Priority: HIGHEST for action security_group_rules [ 914.175994] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd9f990-743b-48e3-b661-540270d91f26 with Priority: HIGHEST for action security_group_rules [ 914.176685] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afd9f990-743b-48e3-b661-540270d91f26 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.177126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afd9f990-743b-48e3-b661-540270d91f26" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.177126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afd9f990-743b-48e3-b661-540270d91f26" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.177260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afd9f990-743b-48e3-b661-540270d91f26" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.177310] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afd9f990-743b-48e3-b661-540270d91f26',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.255029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.255029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.255029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.255029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.255029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.256078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.256078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.256078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.256078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.256078] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.571034] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5b594cb9-ff7f-45dc-bbca-e5786023d65f None None] Enqueued Resource ID: de6090ff-68d0-4468-b627-d0c29f4330f7 with Priority: HIGHEST for action port [ 914.572896] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6090ff-68d0-4468-b627-d0c29f4330f7 with Priority: HIGHEST for action port [ 914.573273] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-de6090ff-68d0-4468-b627-d0c29f4330f7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.573434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de6090ff-68d0-4468-b627-d0c29f4330f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.573959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de6090ff-68d0-4468-b627-d0c29f4330f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.573959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de6090ff-68d0-4468-b627-d0c29f4330f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.573959] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de6090ff-68d0-4468-b627-d0c29f4330f7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.698488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.698656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.698747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.698978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.699084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.699186] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afd9f990-743b-48e3-b661-540270d91f26 already deleted. [ 914.699302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afd9f990-743b-48e3-b661-540270d91f26" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.723190] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-83 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.723424] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.723537] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.723832] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.724104] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.724268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.724416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.724609] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.724839] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.725548] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.725816] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.726120] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.726667] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.726667] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.726667] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.726886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.746621] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.747139] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.747301] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.748334] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.748334] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-d68144d4-a58b-4c9f-8b7b-e931045215f6 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.748334] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.748334] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.748659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.748659] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68144d4-a58b-4c9f-8b7b-e931045215f6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.759793] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e73ec652-3cf2-4f74-85a7-b281cb693a56: rpc.has_security_group_logging(os_id): False [ 914.781335] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.781574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.781655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.781901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.783211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.783211] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.783211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.783211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.783420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.783522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.783729] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.783983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.783983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.785026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.785026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.785026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.785026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.785026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.785026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.785026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.785026] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 914.841015] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.844752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.844752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.844752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.844752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.853096] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 915.076840] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de6090ff-68d0-4468-b627-d0c29f4330f7 [ 915.077134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.077277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.077458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.077638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.077739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.077850] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de6090ff-68d0-4468-b627-d0c29f4330f7 already deleted. [ 915.077931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de6090ff-68d0-4468-b627-d0c29f4330f7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.114746] env[68828]: INFO networking_nsxv3.common.synchronization [req-abbcaf1c-465e-40d0-ab7b-f2b3346c8d7f req-bb5e604a-55f1-4cd1-b439-6072fec09489 tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: 16a2fa39-d89a-4a53-9741-50156406b459 with Priority: HIGHEST for action security_group_rules [ 915.114746] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16a2fa39-d89a-4a53-9741-50156406b459 with Priority: HIGHEST for action security_group_rules [ 915.114746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16a2fa39-d89a-4a53-9741-50156406b459 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.114746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16a2fa39-d89a-4a53-9741-50156406b459" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.114746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16a2fa39-d89a-4a53-9741-50156406b459" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.114746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16a2fa39-d89a-4a53-9741-50156406b459" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.114746] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16a2fa39-d89a-4a53-9741-50156406b459',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.253296] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.253296] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.253296] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.253296] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.253296] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.253742] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.253742] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.253841] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.254189] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.254400] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.254752] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.254922] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.255077] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.255318] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.255461] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.255615] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 is going to be updated. [ 915.284858] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.285183] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.285393] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.285778] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.286082] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.286452] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.634880] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.635154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.635154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.635326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.635405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.635518] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16a2fa39-d89a-4a53-9741-50156406b459 already deleted. [ 915.635593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16a2fa39-d89a-4a53-9741-50156406b459" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.991312] env[68828]: INFO networking_nsxv3.common.synchronization [req-24cfc971-430b-4adf-8079-3b31164b90d9 req-ce780ff2-1f26-4f0c-b023-a1f2ad556f96 service nova] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_rules [ 915.991312] env[68828]: INFO networking_nsxv3.common.synchronization [req-24cfc971-430b-4adf-8079-3b31164b90d9 req-ce780ff2-1f26-4f0c-b023-a1f2ad556f96 service nova] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 915.991706] env[68828]: INFO networking_nsxv3.common.synchronization [req-24cfc971-430b-4adf-8079-3b31164b90d9 req-ce780ff2-1f26-4f0c-b023-a1f2ad556f96 service nova] Enqueued Resource ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 with Priority: HIGHEST for action port [ 915.992117] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_rules [ 915.992117] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 915.992268] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 with Priority: HIGHEST for action port [ 915.992695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.992695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.993182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.993182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.994112] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.998985] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.998985] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.998985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.999491] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.002267] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d68144d4-a58b-4c9f-8b7b-e931045215f6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.002267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.002267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.002267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.002267] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68144d4-a58b-4c9f-8b7b-e931045215f6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.064269] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 in Status: SUCCESS [ 916.064269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.131018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 916.131018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.131289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.131498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.131584] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.462142] env[68828]: INFO networking_nsxv3.common.synchronization [req-fa2dded5-a08f-4ab4-9db2-8a32b0deadbd req-dc772def-60ff-4521-be50-550789211b5b tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: 6e6ab30a-1cd5-425e-be79-f923f7bd474a with Priority: HIGHEST for action security_group_rules [ 916.462525] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e6ab30a-1cd5-425e-be79-f923f7bd474a with Priority: HIGHEST for action security_group_rules [ 916.462865] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e6ab30a-1cd5-425e-be79-f923f7bd474a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.463065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e6ab30a-1cd5-425e-be79-f923f7bd474a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.463199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e6ab30a-1cd5-425e-be79-f923f7bd474a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.463447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e6ab30a-1cd5-425e-be79-f923f7bd474a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.463538] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e6ab30a-1cd5-425e-be79-f923f7bd474a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.503258] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.503379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.506044] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.507250] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d68144d4-a58b-4c9f-8b7b-e931045215f6 with status ACTIVE [ 916.508162] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.508162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.508162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.508432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.508432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.508702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.508898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.509076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.510068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.510068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.510068] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.510824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.510824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.510824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.510824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.510824] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d68144d4-a58b-4c9f-8b7b-e931045215f6 is going to be updated. [ 916.534610] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.535193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.535193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.535416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.535548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.535782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d68144d4-a58b-4c9f-8b7b-e931045215f6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.634399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.634660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.634718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.634951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.635178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.635289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.635385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.635570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.635690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.636088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.636088] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.867032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 916.867260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.984873] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.985133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.985239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.985536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.985536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.985536] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e6ab30a-1cd5-425e-be79-f923f7bd474a already deleted. [ 916.985536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e6ab30a-1cd5-425e-be79-f923f7bd474a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.013172] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.140565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.140734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.140804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.141100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.141283] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.142024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.142024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.142024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.142024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.142024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.142648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.142648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.142648] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.142648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.142891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.142891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.142891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.143037] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.375081] env[68828]: INFO networking_nsxv3.common.synchronization [req-6ac35750-baf3-4efb-89a0-74f5dacbf1e1 req-9a53e625-0f3e-4733-9778-48d387b64163 tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: 209dae04-e532-49cb-8c90-87e7e001f268 with Priority: HIGHEST for action security_group_rules [ 917.375678] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 209dae04-e532-49cb-8c90-87e7e001f268 with Priority: HIGHEST for action security_group_rules [ 917.376331] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-209dae04-e532-49cb-8c90-87e7e001f268 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.376530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-209dae04-e532-49cb-8c90-87e7e001f268" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.376640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-209dae04-e532-49cb-8c90-87e7e001f268" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.376933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-209dae04-e532-49cb-8c90-87e7e001f268" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.377085] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('209dae04-e532-49cb-8c90-87e7e001f268',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.459434] env[68828]: INFO networking_nsxv3.common.synchronization [req-70c96ef9-7783-4f4b-a06b-7a08a0f5e809 req-2f557b0e-0904-4181-a28b-dc9beb54f8e9 tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 917.460242] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 917.460729] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.461081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.461213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.461475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.462136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.462136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.462136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.462136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.462542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.462542] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.516200] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.516347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.516460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.516629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.516726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.516829] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 917.543460] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.543460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.543460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.543460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.543460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.555021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 917.646165] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826410a3-2e17-4f39-bb2e-9ab8ef871c84: rpc.has_security_group_logging(os_id): False [ 917.663762] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.663978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.664066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.664278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.664374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.664615] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.664762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.664841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.664924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.665010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.665188] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.665364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.665465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.665542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.665722] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.665963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.666127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.666127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.666212] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 917.711150] env[68828]: INFO networking_nsxv3.common.synchronization [req-41aaf1e3-59d8-4f60-9106-2dc99af6f512 req-3eebe4db-3c38-4a1e-865b-67cd52be54d7 tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 917.711741] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 917.712528] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.712674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.721558] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.721720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.721767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.722034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.722197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.735420] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 917.747684] env[68828]: INFO networking_nsxv3.common.synchronization [req-0751e502-ce48-4a7f-af0e-7d2a5782cf98 req-a6a79643-4cb4-4a39-87ee-835a03de62b9 tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 917.748188] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 917.749047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.749178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.749246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.749475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.749640] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.749738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.749824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.749995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.750092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.750186] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.900019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.900192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.900247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.900557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.900646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.900746] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 209dae04-e532-49cb-8c90-87e7e001f268 already deleted. [ 917.900829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-209dae04-e532-49cb-8c90-87e7e001f268" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.965883] env[68828]: INFO networking_nsxv3.common.synchronization [req-0751e502-ce48-4a7f-af0e-7d2a5782cf98 req-01f03e67-651a-4ff1-a5eb-da8cc3b71cf8 tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 917.966266] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.967791] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 917.968474] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.968603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.229863] env[68828]: INFO networking_nsxv3.common.synchronization [req-5dd9eb3c-c31a-4b74-8fa9-20cf427de0a7 req-ac578a03-d8b6-42e2-ba63-77d8cf33680b tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 918.230081] env[68828]: INFO networking_nsxv3.common.synchronization [req-5dd9eb3c-c31a-4b74-8fa9-20cf427de0a7 req-ac578a03-d8b6-42e2-ba63-77d8cf33680b tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_members [ 918.230238] env[68828]: INFO networking_nsxv3.common.synchronization [req-5dd9eb3c-c31a-4b74-8fa9-20cf427de0a7 req-ac578a03-d8b6-42e2-ba63-77d8cf33680b tempest-SecurityGroupsTestJSON-1769159093 tempest-SecurityGroupsTestJSON-1769159093-project-member] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 918.230818] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGHEST for action security_group_members [ 918.230963] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGHEST for action security_group_members [ 918.231076] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGHEST for action security_group_members [ 918.231588] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.231588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.231588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.231812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.231991] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.232112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.232176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.232341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.232467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.232582] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.236939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.236939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.236939] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.236939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.236939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.236939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.237829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.237829] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.253174] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.259327] env[68828]: INFO networking_nsxv3.common.synchronization [req-0751e502-ce48-4a7f-af0e-7d2a5782cf98 req-6b00b00f-c599-431d-9bb0-d82bf3ec9744 tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 918.261017] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 918.261829] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.261944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.468092] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.735013] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.735196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.735292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.735527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.740142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.740304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.740601] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.740698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.754161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.754542] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.754693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.754693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.754878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.755036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.755127] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be updated. [ 918.756144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.757014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.757014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.757014] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.757014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.757014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.757014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.757014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.757271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be updated. [ 918.758990] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.758990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.759134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.781390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.782396] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.782396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.782396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.782396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.782396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.782396] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 is going to be updated. [ 918.808215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.808215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.808215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.808945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.809257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.811214] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.811480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.812018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.812018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.812018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.821286] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: IN_PROGRESS for 2s [ 918.821741] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: IN_PROGRESS for 2s [ 918.822541] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.822678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.822748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.822959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.823161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.829588] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: IN_PROGRESS for 2s [ 918.973291] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.973291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.973291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.973291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.973291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.973291] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 918.996282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.996527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.996684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.997053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.997266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.007097] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 919.265947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.266151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.266226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.266471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.266578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.266679] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 919.295497] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.295497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.295497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.295497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.295497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.302232] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 919.565656] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 919.565656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.565656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.566194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.566194] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.566194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.566322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.566509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.566586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.566695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.566788] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.597580] env[68828]: INFO networking_nsxv3.common.synchronization [req-49e54e25-017e-4627-a940-3f29ab572abe req-3bea2eeb-f3de-458a-9a99-9399ae36d1b1 tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 with Priority: HIGHEST for action security_group_rules [ 919.598070] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 with Priority: HIGHEST for action security_group_rules [ 919.598370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.598494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.598563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.598849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.598935] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efe96c6a-51f4-4bd2-9fd2-6061ee429ba0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.748194] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 919.748378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.876156] env[68828]: INFO networking_nsxv3.common.synchronization [req-e6abfd15-f966-46d1-9d37-7c53c57ff7e6 req-1c9069af-c065-48c3-aeeb-c0dabf747106 tempest-MigrationsAdminTest-1798027422 tempest-MigrationsAdminTest-1798027422-project-member] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 919.876675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGHEST for action security_group_members [ 919.876981] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.877116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.877183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.878240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.878481] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.878647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.878749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.879073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.879073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.879250] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.999678] env[68828]: INFO networking_nsxv3.common.synchronization [req-d0309d6b-d27e-4047-8a29-ec78248324d7 req-711d41b7-d076-4fd2-81a6-8907ff8123c2 tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 with Priority: HIGHEST for action security_group_rules [ 919.999905] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 with Priority: HIGHEST for action security_group_rules [ 920.000525] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.000693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.071021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.071210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.071263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.075024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.075024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075024] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.127025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.127025] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 already deleted. [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.127025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.127025] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efe96c6a-51f4-4bd2-9fd2-6061ee429ba0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.381545] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.381850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.381943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.382173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.402354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.402728] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.402859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.402928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.403162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.403253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.403421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be updated. [ 920.430217] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.430404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.430510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.430734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.430876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.438411] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: IN_PROGRESS for 2s [ 920.575500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49bff80d-9c54-4a44-a1a9-f388114a1a64: rpc.has_security_group_logging(os_id): False [ 920.594518] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.594518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.594671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.594813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.615327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.619133] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.619133] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.619133] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.619133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.619698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.619698] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 920.643801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.643960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.644046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.644275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.644373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.644460] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 already deleted. [ 920.644562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.685187] env[68828]: INFO networking_nsxv3.common.synchronization [req-e1258545-75b6-45a1-b066-b34351ba86c1 req-8699bb95-8622-4908-8ef2-5a87d80fdbba tempest-SecurityGroupRulesTestJSON-1185485679 tempest-SecurityGroupRulesTestJSON-1185485679-project-member] Enqueued Resource ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 with Priority: HIGHEST for action security_group_rules [ 920.690981] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.691218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.691322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.691702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.691911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.694028] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 with Priority: HIGHEST for action security_group_rules [ 920.694186] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.694251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.694393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.694729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.694806] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efe96c6a-51f4-4bd2-9fd2-6061ee429ba0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.708036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 920.836379] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec in Status: SUCCESS [ 920.836587] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec deletion is rescheduled due to dependency. [ 920.836753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.838030] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9050286-eb81-4cbb-9bd8-733baee0e20c in Status: SUCCESS [ 920.838030] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c deletion is rescheduled due to dependency. [ 920.838030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.838694] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 in Status: SUCCESS [ 920.839090] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 deletion is rescheduled due to dependency. [ 920.839197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.016788] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 921.017225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.017535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.017854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.018408] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.018653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.018761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.019014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.019197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.019388] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.223873] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.224042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.224116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.224574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.224672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.224784] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efe96c6a-51f4-4bd2-9fd2-6061ee429ba0 already deleted. [ 921.224875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efe96c6a-51f4-4bd2-9fd2-6061ee429ba0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.311524] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 921.311790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.311963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.312552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.312552] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.312552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.312759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.312759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.312904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.312904] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.523323] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.523503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.523616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.523882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.524008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.524245] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.524352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.524415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.524580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.524656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.524793] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 921.551900] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.552063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.552134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.552337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.552580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.561034] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 921.819478] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.819478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.819478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.819478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.822644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.822644] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.822644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.822644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.822644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.822644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.822644] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 921.857699] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.857699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.857699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.857699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.857699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.867152] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 922.450784] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa in Status: SUCCESS [ 922.450990] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa deletion is rescheduled due to dependency. [ 922.451161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.653936] env[68828]: INFO networking_nsxv3.common.synchronization [req-2abcd68c-8383-4a92-a583-916043f06dea req-f32bded5-f3d4-4318-87e7-f8d8cfb557ce tempest-ServersAdminTestJSON-2066352638 tempest-ServersAdminTestJSON-2066352638-project-member] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 922.654612] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGHEST for action security_group_members [ 922.655274] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.656499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.656499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.656499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.656499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.656499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.656499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.657696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.657696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.657696] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.734649] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 922.735034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.160117] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.160510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.160510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.160630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.181419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.181575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.181693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.181761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.181971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.182078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.182175] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be updated. [ 923.209593] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.210325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.210325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.210325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.210325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.221014] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: IN_PROGRESS for 2s [ 923.571752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 923.572021] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 deletion is rescheduled due to dependency. [ 923.572096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.880434] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 923.880738] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 deletion is rescheduled due to dependency. [ 923.880808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.880956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.881283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.881419] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.881560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.881661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.881843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.881926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.882031] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.229746] env[68828]: INFO networking_nsxv3.common.synchronization [req-2cb8b832-4385-4a03-9d5d-3638354d565a req-13b9d06e-c535-4d17-9007-5fd9fa39fd70 tempest-ListServerFiltersTestJSON-1826443975 tempest-ListServerFiltersTestJSON-1826443975-project-member] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 924.230452] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 924.230820] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.231069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.231234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.231480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.231695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.231834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.231920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.232255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.232386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.232580] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.384569] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.384925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.385024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.385269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.385361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.385587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.385693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.385758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.385969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.386010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.386175] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 924.410063] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.410241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.410318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.410514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.410659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.419797] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 924.737126] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.232867] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6a0522b-dbc3-42bf-8801-b6e755596373 in Status: SUCCESS [ 925.233161] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 deletion is rescheduled due to dependency. [ 925.233197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.242777] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.745038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.745219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.745219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.745571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.745748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.745836] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 925.802014] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.802257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.802318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.802534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.802686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.812143] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 926.430745] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 926.430745] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 deletion is rescheduled due to dependency. [ 926.432237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.823410] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 927.823893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.231373] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 929.231714] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 930.206403] env[68828]: INFO networking_nsxv3.common.synchronization [None req-326c8a62-b561-4b03-915a-bb2fdd3df4d5 None None] Enqueued Resource ID: 7204f082-db02-4684-82be-c6e189482df7 with Priority: HIGHEST for action port [ 930.206403] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7204f082-db02-4684-82be-c6e189482df7 with Priority: HIGHEST for action port [ 930.206403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-7204f082-db02-4684-82be-c6e189482df7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.206403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7204f082-db02-4684-82be-c6e189482df7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.206403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7204f082-db02-4684-82be-c6e189482df7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.206403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7204f082-db02-4684-82be-c6e189482df7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.206403] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7204f082-db02-4684-82be-c6e189482df7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.709702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7204f082-db02-4684-82be-c6e189482df7 [ 930.709980] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.710531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.710531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.710531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.710676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.710676] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7204f082-db02-4684-82be-c6e189482df7 already deleted. [ 930.710801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7204f082-db02-4684-82be-c6e189482df7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.712740] env[68828]: INFO networking_nsxv3.common.synchronization [req-48d87d37-50c0-46ad-98f0-9a118590d69f req-fe92a368-0677-468a-a4de-612b8740a56c tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 930.713509] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 930.713952] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.714123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.714222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.714467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.714689] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.714938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.714938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.715048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.715127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.715221] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.217911] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.218084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.218873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.218873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.256830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.257203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.257405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.257524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.257835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.257980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.258158] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 931.294470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.294470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.294597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.294757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.294897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.307110] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 931.378441] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.378681] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.381023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.381023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.381023] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.381023] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.381698] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.382195] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.383032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.383327] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.383628] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.383837] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.384609] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.384609] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.384609] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.384609] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.404425] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.404607] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.404775] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.405179] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.405565] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-96e5a29e-ed48-4b40-adca-2c91bee74f96 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.406370] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.406370] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.406370] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.406542] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96e5a29e-ed48-4b40-adca-2c91bee74f96',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.912066] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.912329] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.912462] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.912928] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.913122] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.913293] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 96e5a29e-ed48-4b40-adca-2c91bee74f96 not found, creating... [ 931.913702] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.914587] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.914587] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.914587] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.914587] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.914787] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.915014] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.915206] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.915446] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.915594] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.915747] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 96e5a29e-ed48-4b40-adca-2c91bee74f96 is going to be created. [ 931.935348] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.935590] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.935653] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.935921] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.936264] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.936413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.788408] env[68828]: INFO networking_nsxv3.common.synchronization [None req-4126bee5-5172-4d6d-9ec5-a506c77ace52 None None] Enqueued Resource ID: 98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289 with Priority: HIGHEST for action port [ 932.788675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289 with Priority: HIGHEST for action port [ 932.789429] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.789512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.789588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.789845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.789925] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.825975] env[68828]: INFO networking_nsxv3.common.synchronization [req-48d87d37-50c0-46ad-98f0-9a118590d69f req-8b8f0da0-19e0-49b6-b4a2-410944e67218 service nova] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_rules [ 932.826884] env[68828]: INFO networking_nsxv3.common.synchronization [req-48d87d37-50c0-46ad-98f0-9a118590d69f req-8b8f0da0-19e0-49b6-b4a2-410944e67218 service nova] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 932.827073] env[68828]: INFO networking_nsxv3.common.synchronization [req-48d87d37-50c0-46ad-98f0-9a118590d69f req-8b8f0da0-19e0-49b6-b4a2-410944e67218 service nova] Enqueued Resource ID: 96e5a29e-ed48-4b40-adca-2c91bee74f96 with Priority: HIGHEST for action port [ 932.828490] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_rules [ 932.828490] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 932.828490] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e5a29e-ed48-4b40-adca-2c91bee74f96 with Priority: HIGHEST for action port [ 932.828811] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.830043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.830043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.830043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.830043] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.831890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.831890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.831890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-96e5a29e-ed48-4b40-adca-2c91bee74f96 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.831890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.831890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.831890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.831890] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96e5a29e-ed48-4b40-adca-2c91bee74f96',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.292751] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289 [ 933.293058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.293134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.293205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.293424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.293517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.293632] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289 already deleted. [ 933.293719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98dbfd57-0c36-4d5a-ad5f-a9cdbe24a289" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.316727] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 933.316932] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 deletion is rescheduled due to dependency. [ 933.317094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.317344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.317912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.318192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.318358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.318430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.318654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.318768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.318909] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.331883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.332031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.338800] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96e5a29e-ed48-4b40-adca-2c91bee74f96 with status ACTIVE [ 933.338800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.338800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.338800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.338800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.338800] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96e5a29e-ed48-4b40-adca-2c91bee74f96 is going to be updated. [ 933.358023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.358023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.358023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.358227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.358264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.358407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96e5a29e-ed48-4b40-adca-2c91bee74f96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.487881] env[68828]: INFO networking_nsxv3.common.synchronization [req-c886fa42-f68a-4401-92cc-9e1aebc83d67 req-0b6daceb-2596-417d-a8ed-01a46907eac5 tempest-ListImageFiltersTestJSON-1716956093 tempest-ListImageFiltersTestJSON-1716956093-project-member] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 933.488135] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 933.489566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.494796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.494796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.494796] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.821309] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.996660] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.996770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.996894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.998017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.998017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.998017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.998017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.998017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.998017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.998513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.998513] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 already deleted. [ 933.998513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.021777] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.021777] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.022016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.022193] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.022456] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.022755] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.022954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.023479] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.023479] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.023615] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.027763] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.027911] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.028048] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.028181] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.028298] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.028447] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.047507] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.048483] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.048483] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.048483] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.048834] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.048834] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.049064] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.050481] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.050680] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f6ad5f-0b3d-4313-9b39-93b9569c8dc7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.323881] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.553022] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.553797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.553797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.553932] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.554221] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.554324] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 not found, creating... [ 934.554702] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.554932] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.555232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.555437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.555644] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.556101] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.556291] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.556466] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.556760] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.556969] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.557338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 is going to be created. [ 934.577920] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.578197] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.578303] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.578580] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.578813] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.579068] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.825991] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.826287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.826404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.826738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.826900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.827089] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 934.854058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.854262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.854307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.854524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.854672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.862853] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 935.438846] env[68828]: INFO networking_nsxv3.common.synchronization [req-c886fa42-f68a-4401-92cc-9e1aebc83d67 req-adb5469e-ee11-4b4a-b63c-839af206cb52 service nova] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_rules [ 935.439119] env[68828]: INFO networking_nsxv3.common.synchronization [req-c886fa42-f68a-4401-92cc-9e1aebc83d67 req-adb5469e-ee11-4b4a-b63c-839af206cb52 service nova] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 935.439276] env[68828]: INFO networking_nsxv3.common.synchronization [req-c886fa42-f68a-4401-92cc-9e1aebc83d67 req-adb5469e-ee11-4b4a-b63c-839af206cb52 service nova] Enqueued Resource ID: 27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 with Priority: HIGHEST for action port [ 935.439469] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_rules [ 935.439685] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 935.439685] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 with Priority: HIGHEST for action port [ 935.440507] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.441092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.441222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.441673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.441673] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.443825] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.444016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.444147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.444583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.445014] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.445014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.445730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.445958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.446132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.446679] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.450231] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.450358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.450427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.450588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.450665] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f6ad5f-0b3d-4313-9b39-93b9569c8dc7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.833108] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd112799-4b99-4f1d-b971-091d5af843ce req-011d936b-5c0e-4719-adc4-cca4a9b2f3a7 tempest-ListImageFiltersTestJSON-1716956093 tempest-ListImageFiltersTestJSON-1716956093-project-member] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 935.833648] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 935.833965] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.834088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.944766] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.945063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.956507] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 with status ACTIVE [ 935.956727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.956868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.956933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.957172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.957266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.957444] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.957563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.957622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.957776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.957855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.958044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.958148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.958221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.958380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.958455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.958540] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27f6ad5f-0b3d-4313-9b39-93b9569c8dc7 is going to be updated. [ 935.961160] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.980316] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.980498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.980542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.980722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.980861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.981035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f6ad5f-0b3d-4313-9b39-93b9569c8dc7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.158837] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.158950] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.159101] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.159376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.159706] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.159912] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.160032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.160265] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.160693] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.160693] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.160866] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.160940] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.162539] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.162539] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.162539] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.162539] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.180213] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.180395] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.180547] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.180737] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-380" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.181087] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.181322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.181434] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.181756] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.181898] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.462226] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.683887] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.684356] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.685173] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.685173] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.685173] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.685445] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e not found, creating... [ 936.685776] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.686159] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.686238] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.686517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.686868] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.687229] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.687492] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.687668] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.689375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.689375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.689375] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e is going to be created. [ 936.706909] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.706909] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.706909] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.706909] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.706909] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.706909] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.879922] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 936.880247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.880472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.880696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.880921] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.881058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.881121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.881288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.881371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.881455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.881545] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.964692] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.964860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.965625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.965625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.965625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.965625] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be created. [ 936.993202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.993580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.993752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.993899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.994118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.005436] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: UNINITIALIZED for 2s [ 937.387020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.387020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387630] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.470436] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd112799-4b99-4f1d-b971-091d5af843ce req-a72d4f79-0f11-4f16-8fd4-745c38e8b4a6 service nova] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_rules [ 937.470818] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd112799-4b99-4f1d-b971-091d5af843ce req-a72d4f79-0f11-4f16-8fd4-745c38e8b4a6 service nova] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 937.470877] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd112799-4b99-4f1d-b971-091d5af843ce req-a72d4f79-0f11-4f16-8fd4-745c38e8b4a6 service nova] Enqueued Resource ID: 7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e with Priority: HIGHEST for action port [ 937.471470] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_rules [ 937.471606] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 937.471656] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e with Priority: HIGHEST for action port [ 937.471915] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.474987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.474987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.474987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.474987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.474987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.474987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.474987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.474987] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.889608] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e63aa4-edf9-4cdd-b540-1791bfdc42d4: rpc.has_security_group_logging(os_id): False [ 937.913012] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.913186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.913186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.913364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.913461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.913711] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.913824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.913891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.914059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.914139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.914777] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.914777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.914777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.914777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.914777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.914982] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.914982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.914982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.915147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.915185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.915264] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 937.976080] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e with status ACTIVE [ 937.976589] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.976589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.976589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.976748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.976748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.976940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.977262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.977262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.977262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.977667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.977667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.977667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.977667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.977894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.977894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.977894] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e is going to be updated. [ 938.002246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.002405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.002445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.002738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.002883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.013478] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.013635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.013709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.013904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.014056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.014219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c6ecd77-414d-4525-a4b3-cbfc42b8bb8e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.017713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 939.015056] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 939.015056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.015056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.015396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.015396] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.015396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.015512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.015648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.015793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.015928] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.520044] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.023590] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.029609] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 940.029829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.527256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.527431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.528023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.528023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.528023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.528184] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be updated. [ 940.554916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.555077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.555150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.555385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.555537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.564655] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 942.472671] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 942.472671] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 942.575897] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 942.576518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.576920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.577371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.578893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.578893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.578893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.578893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.578893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.578893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.578893] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.580013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.580445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.580736] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.580993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.582089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.582089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.582089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.582089] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.081238] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.081401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.084920] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.588659] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.773361] env[68828]: INFO networking_nsxv3.common.synchronization [req-b484a93a-c4d9-4af9-92e7-692a372ad33f req-10191116-e890-4fe5-8059-c34df9151bd8 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 943.776336] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 943.777735] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.777920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.778704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.778704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.778823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.780975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.780975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.780975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.780975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.780975] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.839600] env[68828]: INFO networking_nsxv3.common.synchronization [req-b484a93a-c4d9-4af9-92e7-692a372ad33f req-10191116-e890-4fe5-8059-c34df9151bd8 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 943.839600] env[68828]: INFO networking_nsxv3.common.synchronization [req-b484a93a-c4d9-4af9-92e7-692a372ad33f req-10191116-e890-4fe5-8059-c34df9151bd8 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 943.839600] env[68828]: INFO networking_nsxv3.common.synchronization [req-b484a93a-c4d9-4af9-92e7-692a372ad33f req-10191116-e890-4fe5-8059-c34df9151bd8 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 with Priority: HIGHEST for action port [ 943.839600] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 943.839600] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 943.839600] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 with Priority: HIGHEST for action port [ 943.839600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.839600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.839600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.839600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.839600] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.840261] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.840261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.840261] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd8a70a9-83e9-4c04-8061-dcc0abf67317 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.840261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.840472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.840472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.840532] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd8a70a9-83e9-4c04-8061-dcc0abf67317',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.091378] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.091488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.091739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.091821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.091885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.091992] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be updated. [ 944.119254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.119633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.121094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.121094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.121094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.132212] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 944.288305] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.342102] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.342285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.344062] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd8a70a9-83e9-4c04-8061-dcc0abf67317 with status ACTIVE [ 944.344349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.345143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.345236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.345452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.345542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.345723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.345817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.345878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.346563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.346694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.346941] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.347072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.347144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.347338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.347416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.347534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 is going to be updated. [ 944.369748] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.369908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.369985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.370244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.370547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.370615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.791592] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.296533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.296718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.296793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.297018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.297116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.297223] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be updated. [ 945.324164] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.324340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.324401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.324614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.324835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.333707] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: IN_PROGRESS for 2s [ 946.141982] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 946.142320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.143035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.143035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.143035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.143300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.143300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.143300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.143443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.143443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.143615] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.143680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.143750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.143951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.144103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.144206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.144272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.144430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.144587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.144694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.144783] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.648409] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 061e7957-d08e-4436-88e2-d8f6b78364a8: rpc.has_security_group_logging(os_id): False [ 946.677896] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.678211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.678211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.678350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.678432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.678655] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.678760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.678816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.678971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.679064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.679445] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.679445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.679445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.679700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.679700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.679799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.679869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.679922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.680167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.680251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.680537] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be created. [ 946.734259] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.734417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.734483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.734679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.734899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.747948] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 947.229460] env[68828]: INFO networking_nsxv3.common.synchronization [req-14d2e6b3-fcef-4a0f-ac52-ca156c193e87 req-7dcebd72-e456-4503-bd13-0bfa188894a7 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 947.230051] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 947.230580] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.230580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.256797] env[68828]: INFO networking_nsxv3.common.synchronization [req-14d2e6b3-fcef-4a0f-ac52-ca156c193e87 req-7dcebd72-e456-4503-bd13-0bfa188894a7 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 947.256995] env[68828]: INFO networking_nsxv3.common.synchronization [req-14d2e6b3-fcef-4a0f-ac52-ca156c193e87 req-7dcebd72-e456-4503-bd13-0bfa188894a7 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 947.257582] env[68828]: INFO networking_nsxv3.common.synchronization [req-14d2e6b3-fcef-4a0f-ac52-ca156c193e87 req-7dcebd72-e456-4503-bd13-0bfa188894a7 tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 with Priority: HIGHEST for action port [ 947.257839] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_rules [ 947.258266] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 947.258441] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 with Priority: HIGHEST for action port [ 947.260875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.260875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.260875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.261032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.261163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd8a70a9-83e9-4c04-8061-dcc0abf67317 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.261263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.261327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.261522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.261602] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd8a70a9-83e9-4c04-8061-dcc0abf67317',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.343297] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 947.343528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.343722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.343958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.344168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.344287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.344354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.346307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.346307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.346307] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.719542] env[68828]: INFO networking_nsxv3.common.synchronization [req-af224208-6309-444b-b815-d2e5907b431b req-a4736192-d310-414d-a991-1571accdad8b tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 947.719542] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 947.719542] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.719900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.719900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.719900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.720199] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.720199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.720330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.720450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.720502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.720750] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.769023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd8a70a9-83e9-4c04-8061-dcc0abf67317 with status ACTIVE [ 947.769023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.769023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.769023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.769023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.769023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd8a70a9-83e9-4c04-8061-dcc0abf67317 is going to be updated. [ 947.792911] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.793104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.793199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.793414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.793587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.793735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd8a70a9-83e9-4c04-8061-dcc0abf67317" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.849825] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.225588] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.324512] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.324804] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.324853] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.325133] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.325422] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.325594] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.325711] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.325938] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.326125] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.326350] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.326500] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.326571] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.326693] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.326829] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.326923] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.327074] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.344996] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.345244] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.345411] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.345645] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.346058] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.346248] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.346373] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.346699] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.346846] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9b6c52-676a-4b94-9a44-a75032f8ad8b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.353710] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.729751] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.759203] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 948.759323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.759403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.762644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.762644] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.850026] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.850228] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.850228] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.850939] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.850939] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.850939] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port fa9b6c52-676a-4b94-9a44-a75032f8ad8b not found, creating... [ 948.851120] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.851270] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.851346] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.852032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.852032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.852159] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.852299] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.853025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.853025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.853025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.853308] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: fa9b6c52-676a-4b94-9a44-a75032f8ad8b is going to be created. [ 948.855589] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.855699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.855769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.855925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.856015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.856122] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be updated. [ 948.877082] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.877573] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.877573] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.877857] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.878575] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.878865] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.884815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.884971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.885568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.885568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.885568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.894237] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: IN_PROGRESS for 2s [ 949.237129] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.237129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.237129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.237370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.237370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.237453] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 949.262776] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.263069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.263156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.263384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.263605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.266417] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.266560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.266675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.266827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.266994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.267312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.267380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.267560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.267650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.267805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.268150] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.276416] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 949.649729] env[68828]: INFO networking_nsxv3.common.synchronization [req-ee387bd9-df72-48ee-8a35-8852e3faa3a9 req-d044691d-6089-4036-a28a-2999f3a34162 tempest-ServersNegativeTestJSON-1274465967 tempest-ServersNegativeTestJSON-1274465967-project-member] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 949.650286] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGHEST for action security_group_members [ 949.650614] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.651321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.651321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.651321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.651626] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.651738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.651804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.653220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.653317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.653460] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.771094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.771401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.771502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.771743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.771951] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.772072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.772152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.773385] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.773385] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.773385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.773848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.773848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.773848] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.852056] env[68828]: INFO networking_nsxv3.common.synchronization [req-af224208-6309-444b-b815-d2e5907b431b req-ca6fb2c1-84a7-4618-a64e-56f0a1ba2ee9 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 949.852507] env[68828]: INFO networking_nsxv3.common.synchronization [req-af224208-6309-444b-b815-d2e5907b431b req-ca6fb2c1-84a7-4618-a64e-56f0a1ba2ee9 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 949.852507] env[68828]: INFO networking_nsxv3.common.synchronization [req-af224208-6309-444b-b815-d2e5907b431b req-ca6fb2c1-84a7-4618-a64e-56f0a1ba2ee9 service nova] Enqueued Resource ID: fa9b6c52-676a-4b94-9a44-a75032f8ad8b with Priority: HIGHEST for action port [ 949.853243] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 949.853389] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 949.853489] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9b6c52-676a-4b94-9a44-a75032f8ad8b with Priority: HIGHEST for action port [ 949.853797] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.853983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.854946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.854946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.854946] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.855686] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.855778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.855973] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.856858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.856858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.856858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.856858] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9b6c52-676a-4b94-9a44-a75032f8ad8b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.163086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.163086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.163086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.163086] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be updated. [ 950.190036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.190195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.190264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.190472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.190778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.199812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: IN_PROGRESS for 2s [ 950.279598] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 061e7957-d08e-4436-88e2-d8f6b78364a8: rpc.has_security_group_logging(os_id): False [ 950.298203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.298203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.298203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.298334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.298417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.298657] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.298764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.298824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.298976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.299073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.299258] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.299347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.299421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.299580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.299664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.299884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.302229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.302356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.306024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.306024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.306024] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be updated. [ 950.358947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.359118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.359330] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa9b6c52-676a-4b94-9a44-a75032f8ad8b with status ACTIVE [ 950.361956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.361956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.361956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.361956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.361956] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa9b6c52-676a-4b94-9a44-a75032f8ad8b is going to be updated. [ 950.364365] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.364548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.364707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.364877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.365096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.379391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 950.386587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.386853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.386984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.387329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.387558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.387821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa9b6c52-676a-4b94-9a44-a75032f8ad8b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.903534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 950.903851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.904204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.904204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.904335] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.904447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.904510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.904664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.904740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.904822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.904939] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.905786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.906272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.906272] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.906272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.906272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.906455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.906489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.910018] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.288045] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 951.288410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.288496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.288835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.288916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.289021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.289390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.289390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.289390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.289390] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.408318] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.410275] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.694308] env[68828]: INFO networking_nsxv3.common.synchronization [req-587d4ada-7400-48b8-bcf3-e29814b09582 req-c93ee0ca-b5fe-48d0-b835-f7ce510b8e4a tempest-AttachInterfacesUnderV243Test-1723138147 tempest-AttachInterfacesUnderV243Test-1723138147-project-member] Enqueued Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 951.694818] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 with Priority: HIGHEST for action security_group_members [ 951.699088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.699351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.792571] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.911596] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61fe50ff-0f58-47fa-9ef5-7eec076d9a64: rpc.has_security_group_logging(os_id): False [ 951.912968] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.929767] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.929899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.929967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.930195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.946856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.947289] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.947445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.947535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.947790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.947904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.948039] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be updated. [ 952.006358] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.006659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.006775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.007022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.007258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.021748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: IN_PROGRESS for 2s [ 952.210425] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 in Status: SUCCESS [ 952.210425] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 deletion is rescheduled due to dependency. [ 952.210425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.296944] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.393707] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 952.393707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.416256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.418571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.418571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.418571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.418571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.418571] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be updated. [ 952.446844] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.446844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.446844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.446844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.446844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.454222] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: IN_PROGRESS for 2s [ 952.541040] env[68828]: INFO networking_nsxv3.common.synchronization [req-90cb3440-8938-4c1c-a604-519940d7167a req-ccd203e9-e12c-49a2-b503-88b936ca67ff tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 952.541040] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 952.541965] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.542327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.542736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.543099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.544968] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.544968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.544968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.544968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.544968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.544968] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.765073] env[68828]: INFO networking_nsxv3.common.synchronization [None req-aeabc430-377a-4f9e-a525-44362b5319a7 tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: afbe7db5-bbea-4851-9c02-289b6b2a0aaf with Priority: HIGHEST for action security_group_rules [ 952.765477] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afbe7db5-bbea-4851-9c02-289b6b2a0aaf with Priority: HIGHEST for action security_group_rules [ 952.765786] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.765906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.766036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.767130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.767232] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afbe7db5-bbea-4851-9c02-289b6b2a0aaf',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.801490] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.801636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.801704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.801916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.802018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.802544] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 952.835175] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.835365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.835365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.835513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.835671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.846060] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 952.889314] env[68828]: INFO networking_nsxv3.common.synchronization [None req-62dbb9e0-8c99-4d98-b7d4-ed0a3289ac54 tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: afbe7db5-bbea-4851-9c02-289b6b2a0aaf with Priority: HIGHEST for action security_group_rules [ 952.889849] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afbe7db5-bbea-4851-9c02-289b6b2a0aaf with Priority: HIGHEST for action security_group_rules [ 952.894342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.894342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.894342] env[68828]: INFO networking_nsxv3.common.synchronization [req-da951e2f-3fd2-47e2-89d3-d55d2b76de95 req-eceb512a-8e3f-4e8d-8350-7cbf160a69d8 tempest-ServersWithSpecificFlavorTestJSON-1891684402 tempest-ServersWithSpecificFlavorTestJSON-1891684402-project-member] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 952.894475] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGHEST for action security_group_members [ 952.894636] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.894746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.894811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.895038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.895194] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.895292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.895349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.895503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.895592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.895669] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.051136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.051667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.051667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.051667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.051667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.051852] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.051950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.052011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.052191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.052296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.052406] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 953.084052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.084206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.084279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.084607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.084607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.096218] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 953.293553] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.293769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.293823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.294079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.294177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.294277] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afbe7db5-bbea-4851-9c02-289b6b2a0aaf already deleted. [ 953.294599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.294599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.294701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.294772] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afbe7db5-bbea-4851-9c02-289b6b2a0aaf',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.405042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.405042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.405042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.405042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.424875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.425198] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.425325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.425392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.425594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.425677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.425766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be updated. [ 953.449502] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.449620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.449684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.449917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.450078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.459240] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: IN_PROGRESS for 2s [ 953.819546] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.819865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.819865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.820120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.820260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.820375] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afbe7db5-bbea-4851-9c02-289b6b2a0aaf already deleted. [ 953.820589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afbe7db5-bbea-4851-9c02-289b6b2a0aaf" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.035691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 954.035979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.036187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.036427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.036521] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.465941] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 in Status: SUCCESS [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.465941] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.465941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.465941] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.558350] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.558487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.558560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.558804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.558868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.559029] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be deleted. [ 954.610144] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.610144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.610144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.610331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.610423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.610554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.857466] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 954.857766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.857958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.858197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.858387] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.858517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.858574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.858897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.858897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.858897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.859094] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.969123] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.969473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.969520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.969755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.969865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.970196] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.970360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.970420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.970783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.970866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.971907] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 is going to be deleted. [ 954.999944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.000177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.000279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.000501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.000596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.000732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.001303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.001485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.001661] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.001820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.001901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.002123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.002228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.002301] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fe50ff-0f58-47fa-9ef5-7eec076d9a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.107442] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 955.107442] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 deletion is rescheduled due to dependency. [ 955.107442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.361437] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.361686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.361745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.361985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.362195] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.362343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.362390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.362798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.362889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.362984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.363177] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.363248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.363334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.363537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.363753] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.363863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.363955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.364122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.364204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.364289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.365276] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.469393] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc128506-c5e7-4179-a805-6679a20e9957 in Status: SUCCESS [ 955.469674] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc128506-c5e7-4179-a805-6679a20e9957 deletion is rescheduled due to dependency. [ 955.469674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.507058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.507058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.507058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.507058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.507058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.507635] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.507635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.507635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.507635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.507799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.507799] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fe50ff-0f58-47fa-9ef5-7eec076d9a64 already deleted. [ 955.507867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fe50ff-0f58-47fa-9ef5-7eec076d9a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.867841] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fdb4832-fb6b-46dc-9929-5e545ccfc219: rpc.has_security_group_logging(os_id): False [ 955.888881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.889052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.889127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.889475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.889475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.889630] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.889724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.889756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.889901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.889973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.890173] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.890287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.890318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.890481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.890529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.890686] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.890756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.890826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.890962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.891264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.891380] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 955.963347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.963347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.963533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.963752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.963752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.979763] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 956.336805] env[68828]: INFO networking_nsxv3.common.synchronization [req-5026501a-3056-4123-b0a9-804c4e1f5056 req-3b04377f-92a7-4af1-b7cd-83e8d1cfcc7b tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 956.337498] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 956.337852] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.338049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.338168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.338427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.339642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.339642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.339642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.339642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.339642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.339642] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.440109] env[68828]: INFO networking_nsxv3.common.synchronization [req-bd8e372d-8252-493a-a497-8d989cd40b7f req-79d2c9ff-1d03-479c-8b68-941815d710cf tempest-ListServerFiltersTestJSON-1826443975 tempest-ListServerFiltersTestJSON-1826443975-project-member] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 956.440962] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGHEST for action security_group_members [ 956.441370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.444371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.444371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.444371] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.642288] env[68828]: INFO networking_nsxv3.common.synchronization [req-593baef0-c283-4bd6-8e4b-a7f378335719 req-40661791-3602-4521-b2a8-b98813b2bb3d tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 956.642990] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 956.643244] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.643393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.643466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.643709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.643906] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.644037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.644665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.644868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.645032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.645113] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.844827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.844827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.844827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.844827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.865282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.865493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.865618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.865708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.866831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.866920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.867042] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 956.897409] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.897604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.897673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.897913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.898528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.908431] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 956.947684] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.947826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.947895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.948667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.948667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.948667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.948667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.948667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.948923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.948923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.948989] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be updated. [ 956.978273] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.978661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.978661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.978764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.978851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.991827] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: IN_PROGRESS for 2s [ 957.092966] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.093211] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.093339] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.093620] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.093923] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.094114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.094236] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.094614] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.094614] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.094844] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.094965] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.095127] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.095299] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.095366] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.095479] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.095619] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.112638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.112932] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.113137] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.113348] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.113721] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-4e2fe752-2a1a-4454-98a3-c3e56414020a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.114192] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.114192] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.114376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.114499] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e2fe752-2a1a-4454-98a3-c3e56414020a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.151253] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.601087] env[68828]: INFO networking_nsxv3.common.synchronization [req-6e6d6a82-8d82-4f57-9c80-7d67da68548b req-6a727576-fa2a-4121-8e3d-2c9875674a53 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 957.601645] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 957.602011] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.602166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.602233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.602511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.602747] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.602856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.602936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.603104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.603197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.603293] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.617293] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.617553] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.617683] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.617993] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.618189] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.618367] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 4e2fe752-2a1a-4454-98a3-c3e56414020a not found, creating... [ 957.618661] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.618844] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.618987] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.619258] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.619425] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.619740] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.619930] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.620081] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.620335] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.620479] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.620646] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 4e2fe752-2a1a-4454-98a3-c3e56414020a is going to be created. [ 957.640823] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.641221] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.641385] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.641912] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.642180] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.642457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.652801] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.996934] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 957.998090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.107389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.107389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.107389] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 already deleted. [ 958.107389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.157587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.157587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.157587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.157587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.157587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.157587] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 958.189033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.189033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.189033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.189033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.189033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.196560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 958.223231] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.223541] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.223815] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.224263] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.224565] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.224737] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.224875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.225124] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.225282] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.225503] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.225730] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.225730] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.225899] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.226121] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.226121] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.226279] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.247087] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.247253] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.247401] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.247585] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.247937] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-f5061d8f-7309-4b0a-8477-f66b91bc7902 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.248133] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.248330] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.248577] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.248726] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5061d8f-7309-4b0a-8477-f66b91bc7902',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.753510] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.753773] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.753905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.754231] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.754391] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.754556] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port f5061d8f-7309-4b0a-8477-f66b91bc7902 not found, creating... [ 958.754829] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.754996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.755129] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.755354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.755499] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.755793] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.755956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.756760] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.757080] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.757284] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.757473] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: f5061d8f-7309-4b0a-8477-f66b91bc7902 is going to be created. [ 958.765727] env[68828]: INFO networking_nsxv3.common.synchronization [req-593baef0-c283-4bd6-8e4b-a7f378335719 req-d8c7834b-d30a-454b-a0da-2ef70bc078c7 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 958.765921] env[68828]: INFO networking_nsxv3.common.synchronization [req-593baef0-c283-4bd6-8e4b-a7f378335719 req-d8c7834b-d30a-454b-a0da-2ef70bc078c7 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 958.766084] env[68828]: INFO networking_nsxv3.common.synchronization [req-593baef0-c283-4bd6-8e4b-a7f378335719 req-d8c7834b-d30a-454b-a0da-2ef70bc078c7 service nova] Enqueued Resource ID: 4e2fe752-2a1a-4454-98a3-c3e56414020a with Priority: HIGHEST for action port [ 958.768093] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 958.768316] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 958.768412] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2fe752-2a1a-4454-98a3-c3e56414020a with Priority: HIGHEST for action port [ 958.768698] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.769288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.769350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.770802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.770904] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.771872] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.771985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.772621] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e2fe752-2a1a-4454-98a3-c3e56414020a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.772621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.772621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.772621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.772621] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e2fe752-2a1a-4454-98a3-c3e56414020a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.790470] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.790782] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.790867] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.791090] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.791337] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.791583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.918530] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 958.918782] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 958.918930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.000963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 309bda50-1db3-47e1-b12b-431331217ccd in Status: SUCCESS [ 959.001520] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 309bda50-1db3-47e1-b12b-431331217ccd deletion is rescheduled due to dependency. [ 959.001520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.275118] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.275118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.279323] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e2fe752-2a1a-4454-98a3-c3e56414020a with status ACTIVE [ 959.279562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.279696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.279763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.280134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.280134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.280279] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.280352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.280409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.280555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.280633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.280808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.280902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.280959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.281113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.281180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.281265] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e2fe752-2a1a-4454-98a3-c3e56414020a is going to be updated. [ 959.305040] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.305269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.305381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.305673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.306067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.306278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e2fe752-2a1a-4454-98a3-c3e56414020a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.351941] env[68828]: INFO networking_nsxv3.common.synchronization [None req-e66f9a65-5cf3-4c79-9d48-1f333f3a6af0 None None] Enqueued Resource ID: fdbefa60-4776-4e73-84f8-7ea3ed0a63d1 with Priority: HIGHEST for action port [ 959.352224] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbefa60-4776-4e73-84f8-7ea3ed0a63d1 with Priority: HIGHEST for action port [ 959.354422] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdbefa60-4776-4e73-84f8-7ea3ed0a63d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.354422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdbefa60-4776-4e73-84f8-7ea3ed0a63d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.354422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdbefa60-4776-4e73-84f8-7ea3ed0a63d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.354422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdbefa60-4776-4e73-84f8-7ea3ed0a63d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.354422] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdbefa60-4776-4e73-84f8-7ea3ed0a63d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.503455] env[68828]: INFO networking_nsxv3.common.synchronization [req-6e6d6a82-8d82-4f57-9c80-7d67da68548b req-8b936aac-c0d7-40f5-a1a7-71930a35382f service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 959.503755] env[68828]: INFO networking_nsxv3.common.synchronization [req-6e6d6a82-8d82-4f57-9c80-7d67da68548b req-8b936aac-c0d7-40f5-a1a7-71930a35382f service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 959.503948] env[68828]: INFO networking_nsxv3.common.synchronization [req-6e6d6a82-8d82-4f57-9c80-7d67da68548b req-8b936aac-c0d7-40f5-a1a7-71930a35382f service nova] Enqueued Resource ID: f5061d8f-7309-4b0a-8477-f66b91bc7902 with Priority: HIGHEST for action port [ 959.504707] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 959.504852] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 959.504952] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5061d8f-7309-4b0a-8477-f66b91bc7902 with Priority: HIGHEST for action port [ 959.509420] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.509589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.509646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.509942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.510044] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.511041] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.511189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.511288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.511429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.511600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.511708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.511821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.511949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.512535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.512677] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.513859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5061d8f-7309-4b0a-8477-f66b91bc7902 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.513976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.514073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.514409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.514902] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5061d8f-7309-4b0a-8477-f66b91bc7902',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.686345] env[68828]: INFO networking_nsxv3.common.synchronization [req-717c4382-c703-457a-8819-44e992890f4a req-5794bdeb-ec70-4671-846c-8a5ffd3a219a tempest-InstanceActionsNegativeTestJSON-60385423 tempest-InstanceActionsNegativeTestJSON-60385423-project-member] Enqueued Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_members [ 959.687717] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_members [ 959.688261] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.688645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.688645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.689237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.689516] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.689684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.689791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.690083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.690277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.690435] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.857691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdbefa60-4776-4e73-84f8-7ea3ed0a63d1 [ 959.857961] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.858173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.858210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.858430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.858514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.858616] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdbefa60-4776-4e73-84f8-7ea3ed0a63d1 already deleted. [ 959.858757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdbefa60-4776-4e73-84f8-7ea3ed0a63d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.021430] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5061d8f-7309-4b0a-8477-f66b91bc7902 with status ACTIVE [ 960.021430] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.021430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.021430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.021430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.021430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.021430] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.021430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.021430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.021905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.021905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.021966] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.022371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.022646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.023118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.023118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.023271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5061d8f-7309-4b0a-8477-f66b91bc7902 is going to be updated. [ 960.024687] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.025731] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.025844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.046793] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.047617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.047617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.047737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.047884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.047967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5061d8f-7309-4b0a-8477-f66b91bc7902" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.194869] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.194869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.194869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.194869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.195081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.195282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.195366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.195366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.195536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.195590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.195756] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 already deleted. [ 960.195803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.213366] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 960.213640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.215073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.215073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.215073] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.215073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.215073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.215073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.215073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.215418] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.385072] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.385276] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-791" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.385409] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-791" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.385759] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-791" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.387129] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.387424] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.387573] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.390185] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.390398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.390690] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.390902] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.390902] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.391082] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.391328] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.391328] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.391456] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.413548] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.413811] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.414063] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.414185] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-791" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.414544] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-380a83ee-9eb6-4527-a10b-20b95ec276b7 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.414745] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.415549] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.415922] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.416091] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380a83ee-9eb6-4527-a10b-20b95ec276b7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.529909] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.718451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.920039] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.921138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.921138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.921138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.921138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.921138] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 380a83ee-9eb6-4527-a10b-20b95ec276b7 not found, creating... [ 960.924157] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.924157] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.924157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.925124] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 380a83ee-9eb6-4527-a10b-20b95ec276b7 is going to be created. [ 960.947176] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.947176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.947176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.947176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.947579] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.947579] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.034938] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.035259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.035411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.035762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.035924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.036580] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be created. [ 961.069197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.072036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.072036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.072036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.072036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.084895] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: UNINITIALIZED for 2s [ 961.222218] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.248216] env[68828]: INFO networking_nsxv3.common.synchronization [None req-0e6ccd58-8dd4-4a0c-a6e0-9599db93122d tempest-ServersTestJSON-438167534 tempest-ServersTestJSON-438167534-project-member] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_rules [ 961.249645] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_rules [ 961.250487] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.250937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.251168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.252845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.252845] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.356097] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9dc62fdc-8cae-4fcb-aa7e-bd1bcb9e6521 tempest-ServersTestJSON-438167534 tempest-ServersTestJSON-438167534-project-member] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_rules [ 961.356097] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_rules [ 961.356097] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.356097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.715527] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-cb393929-55d6-48bd-81eb-9c9f7d7548f2 tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 961.715919] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 961.716260] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.716380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.716487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.716648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.716788] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.716889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.716954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.722403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.722577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.722693] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.725169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.725313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.725371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.726088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.726194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.726299] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 961.753067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.753266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.753333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.753499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.753649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.765963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 961.776177] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.776177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.776177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.776177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.776177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.776177] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ffdab8-bf16-471f-9412-c5026034844d already deleted. [ 961.776561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.776561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.776561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.776663] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.997270] env[68828]: INFO networking_nsxv3.common.synchronization [None req-1ffd374c-5e12-4a78-ac93-f9b50341d8f5 None None] Enqueued Resource ID: 710dc11c-24b8-4caa-8586-5ab3677b4793 with Priority: HIGHEST for action port [ 961.998032] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710dc11c-24b8-4caa-8586-5ab3677b4793 with Priority: HIGHEST for action port [ 961.998277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-710dc11c-24b8-4caa-8586-5ab3677b4793 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.998552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-710dc11c-24b8-4caa-8586-5ab3677b4793" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.998552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-710dc11c-24b8-4caa-8586-5ab3677b4793" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.998766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-710dc11c-24b8-4caa-8586-5ab3677b4793" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.998862] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710dc11c-24b8-4caa-8586-5ab3677b4793',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.092435] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-610 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.092662] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.092852] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.093237] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.093878] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.094593] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.094593] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.094593] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.094985] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.095261] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.095438] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.095623] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.095782] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.096601] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.096601] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.096601] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.115054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.116178] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.116441] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.116782] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.117130] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-183d8693-8e0d-459b-a08a-ea2a51c55fe8 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.117425] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.117501] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.117834] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.117998] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('183d8693-8e0d-459b-a08a-ea2a51c55fe8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.226341] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.226620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.226724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.227070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.227247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.227562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.227698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.227782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.228021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.228155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.228291] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 962.258044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.258044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.258044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.258044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.258044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.262278] env[68828]: INFO networking_nsxv3.common.synchronization [req-717c4382-c703-457a-8819-44e992890f4a req-94be1f58-5b07-4629-aacc-7a83659c1187 service nova] Enqueued Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_rules [ 962.263837] env[68828]: INFO networking_nsxv3.common.synchronization [req-717c4382-c703-457a-8819-44e992890f4a req-94be1f58-5b07-4629-aacc-7a83659c1187 service nova] Enqueued Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_members [ 962.266149] env[68828]: INFO networking_nsxv3.common.synchronization [req-717c4382-c703-457a-8819-44e992890f4a req-94be1f58-5b07-4629-aacc-7a83659c1187 service nova] Enqueued Resource ID: 380a83ee-9eb6-4527-a10b-20b95ec276b7 with Priority: HIGHEST for action port [ 962.266534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 962.267154] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_rules [ 962.267363] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_members [ 962.267524] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380a83ee-9eb6-4527-a10b-20b95ec276b7 with Priority: HIGHEST for action port [ 962.268614] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.268614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.268614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.268614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.268614] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.269669] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.269808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.269906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.270137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.270359] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.271142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.271386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.271606] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.271815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.272076] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.273310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-380a83ee-9eb6-4527-a10b-20b95ec276b7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.273473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.273571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.273931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.273931] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380a83ee-9eb6-4527-a10b-20b95ec276b7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.301720] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.301720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.301720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.301720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.301720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.301720] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ffdab8-bf16-471f-9412-c5026034844d already deleted. [ 962.301720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.504908] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 710dc11c-24b8-4caa-8586-5ab3677b4793 [ 962.506036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.506036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.506036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.506036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.506036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.506036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:710dc11c-24b8-4caa-8586-5ab3677b4793 already deleted. [ 962.506036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-710dc11c-24b8-4caa-8586-5ab3677b4793" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.624020] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.624020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.624020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.624020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.624020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.624020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 183d8693-8e0d-459b-a08a-ea2a51c55fe8 not found, creating... [ 962.624020] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.624020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.624793] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.625173] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.625432] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.625827] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.626236] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.626568] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.626931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.627227] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.627482] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 183d8693-8e0d-459b-a08a-ea2a51c55fe8 is going to be created. [ 962.646758] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.647109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.647241] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.648735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.648735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.648735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.778169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.778399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.778646] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.781197] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 380a83ee-9eb6-4527-a10b-20b95ec276b7 with status ACTIVE [ 962.781197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.781197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.781197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.781197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.781197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.781197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.781197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.781197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.781663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.781663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.781663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.781817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.781817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.783321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.783321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.783321] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 380a83ee-9eb6-4527-a10b-20b95ec276b7 is going to be updated. [ 962.807203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.807203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.807203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.807203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.807537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.807537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-380a83ee-9eb6-4527-a10b-20b95ec276b7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.095605] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 963.095871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.096083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.097101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.097101] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.097101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.097101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.097292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.097377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.097537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.097700] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.285760] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.368591] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-d46d2bce-66ac-4178-9746-d4f47ef58898 service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 963.368811] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-d46d2bce-66ac-4178-9746-d4f47ef58898 service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 963.369202] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-d46d2bce-66ac-4178-9746-d4f47ef58898 service nova] Enqueued Resource ID: 183d8693-8e0d-459b-a08a-ea2a51c55fe8 with Priority: HIGHEST for action port [ 963.369613] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 963.369816] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 963.369853] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 183d8693-8e0d-459b-a08a-ea2a51c55fe8 with Priority: HIGHEST for action port [ 963.370131] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.370231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.370300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.370499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.370579] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.371511] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.371511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.371672] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-183d8693-8e0d-459b-a08a-ea2a51c55fe8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.371767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.371850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.371990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.372078] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('183d8693-8e0d-459b-a08a-ea2a51c55fe8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.607037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.607037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.607037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.607037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.607037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.607871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.607871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.607871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.607871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.608438] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.782444] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 963.782697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.782931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.783179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.783379] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.783499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.783556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.783719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.783890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.784016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.784123] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.787850] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.788011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.788099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.788288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.788376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.788470] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 is going to be created. [ 963.811652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.811860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.811860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.812109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.812275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.821485] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 in Status: UNINITIALIZED for 2s [ 963.874136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.874363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.876628] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 183d8693-8e0d-459b-a08a-ea2a51c55fe8 with status ACTIVE [ 963.876824] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.877025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.877025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.877254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.877347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.877546] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.877658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.877730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.877876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.877969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.878154] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.878277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.878319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.878497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.878535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.878615] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 183d8693-8e0d-459b-a08a-ea2a51c55fe8 is going to be updated. [ 963.898169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.898427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.898427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.898575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.898732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.898914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-183d8693-8e0d-459b-a08a-ea2a51c55fe8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.111467] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f4a4187-5566-42ed-af79-13c7cf7b4577: rpc.has_security_group_logging(os_id): False [ 964.130175] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.130497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.130497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.130656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.130738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.131297] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.131297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.131297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.131297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.131541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.131541] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.131635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.131681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.131829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.131912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.132135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.132225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.132291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.132430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.132507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.132591] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be created. [ 964.188024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.188024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.188024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.188024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.188024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.199121] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 964.280562] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 964.280562] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 deletion is rescheduled due to dependency. [ 964.280910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.281195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.283019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.283019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.283019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.283019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.283019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.283019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.283019] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.286613] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.286613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.286853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.286853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.287047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.287119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.287181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.287327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.287490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.287490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.287636] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.287728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.287788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.287928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.288123] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.288225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.288287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.288427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.288504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.288583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.288670] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.328468] env[68828]: INFO networking_nsxv3.common.synchronization [None req-4a37e06e-cce3-409e-98a0-a4bda8ba0edd tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_rules [ 964.328902] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_rules [ 964.329223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.329339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.329412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.330034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.330034] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.420967] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b017a43a-a389-4b68-9817-36f7af16ab46 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_rules [ 964.421464] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_rules [ 964.422141] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.422141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.493416] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-733ca6c4-4c4d-40d6-b93f-f1f8727627e6 tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 964.493996] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 964.494426] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.494558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.785542] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.794449] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 964.819152] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.819306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.819379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.819598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.819693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.819884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.819984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.820060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.820212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.820289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.820491] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.820581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.820706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.820864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.820943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.821140] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.821232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.821294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.821431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.821520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.821594] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 964.862220] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.862415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.862530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.862829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.862947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.863081] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 already deleted. [ 964.863170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.863319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.863490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.863573] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.897150] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.897397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.897461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.897758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.897910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.911409] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 965.296156] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.384929] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.385612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.385612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.385612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.385825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.385868] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 already deleted. [ 965.385965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.799135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.799321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.799475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.799582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.799713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.799776] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 965.828317] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-610 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.828882] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.829105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.829501] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.829881] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.830132] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.830310] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.830621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.830867] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.831216] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.831395] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.831561] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.831725] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.831895] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.832077] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.832273] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.834664] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.834817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.834905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.835134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.835312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.847975] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 965.848982] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 in Status: SUCCESS [ 965.849227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.849534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.849809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.850062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.850213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.850303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.850513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.850621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.850740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.850863] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.858252] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.858499] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 965.858659] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.858829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-610" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.859161] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-3a553e1b-3792-4006-88d6-0d2d4022ce32 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.859331] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.859453] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.859775] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.860020] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a553e1b-3792-4006-88d6-0d2d4022ce32',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.219744] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 966.220087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.353401] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.353894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.353894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.353990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.354292] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.354409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.354482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.354703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.354801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.354941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.355116] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.355347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.355477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.355727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.356483] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.356483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.356483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.356663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.356738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.356935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.357073] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.366543] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.366876] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.367047] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.367395] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.367523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.367690] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 3a553e1b-3792-4006-88d6-0d2d4022ce32 not found, creating... [ 966.367986] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.368179] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.368356] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.368578] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.368748] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.369889] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.370115] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.370251] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.370503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.371189] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.371461] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 3a553e1b-3792-4006-88d6-0d2d4022ce32 is going to be created. [ 966.397194] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.397408] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.397539] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.397836] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.398087] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.398329] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.859638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df1d5f70-a74c-42f7-ac16-3a22419f5e48: rpc.has_security_group_logging(os_id): False [ 966.877820] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.878237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.878237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.878316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.878382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.878621] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.878763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.878827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.878994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.879222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.879481] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.879612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.879678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.879878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.879974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.880207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.880391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.880534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.880609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.880697] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 is going to be created. [ 966.923750] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 966.924398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.935263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.935368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.935368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.935578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.935793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.945402] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 in Status: IN_PROGRESS for 2s [ 967.584017] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-179154c8-a49c-4412-bd8b-7e81e02d3672 service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 967.584363] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-179154c8-a49c-4412-bd8b-7e81e02d3672 service nova] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 967.584443] env[68828]: INFO networking_nsxv3.common.synchronization [req-4b80c480-3361-4abe-82b3-57274abb7431 req-179154c8-a49c-4412-bd8b-7e81e02d3672 service nova] Enqueued Resource ID: 3a553e1b-3792-4006-88d6-0d2d4022ce32 with Priority: HIGHEST for action port [ 967.584675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_rules [ 967.584800] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 967.584896] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a553e1b-3792-4006-88d6-0d2d4022ce32 with Priority: HIGHEST for action port [ 967.585473] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.585584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.585783] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.585870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.588112] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a553e1b-3792-4006-88d6-0d2d4022ce32 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.588257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.588329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.588536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.588732] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a553e1b-3792-4006-88d6-0d2d4022ce32',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.857256] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 967.857481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.857757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.857896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.858108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.858224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.858290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.858441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.858520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.858604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.858700] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.859699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.861098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.861098] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.861098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.861098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.861098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.861098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.861098] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.095114] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a553e1b-3792-4006-88d6-0d2d4022ce32 with status ACTIVE [ 968.095347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.095506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.095579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.095807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.095912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.096115] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.096235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.096299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.096459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.096537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.096721] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.096814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.096870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.097033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.097114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.097201] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a553e1b-3792-4006-88d6-0d2d4022ce32 is going to be updated. [ 968.128403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.128605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.128701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.128962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.129133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.129321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a553e1b-3792-4006-88d6-0d2d4022ce32" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.362117] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.363795] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.363795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.606490] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-55483adb-1344-4f36-a852-ab04136df14e tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 968.607388] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 968.607922] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.609201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.609467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.609785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.610066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.610377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.610544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.611059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.613148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.613148] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.864859] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.926396] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-084f8d5b-ea9c-4137-9d2d-a309ef25cfb7 tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 968.927074] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 968.927413] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.927514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.956827] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 in Status: SUCCESS [ 968.957098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.114963] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.115365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.115365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.115490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.115582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.115814] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.115931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.116037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.116200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.116291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.116381] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 969.141716] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.141872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.141920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.142163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.142305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.150830] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 969.367644] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.367766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.367766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.368009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.368108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.368211] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 969.393987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.394137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.394208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.394412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.394555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.402603] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 969.512130] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-896" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-896" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-896" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.512130] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.512130] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.512130] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.512130] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.512130] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.512130] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.512737] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.512737] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.512737] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.533674] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.534018] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.534227] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.534461] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-896" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.534824] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-cc8552c2-ca23-4ff6-b3af-1023c397bf96 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.535122] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.535331] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.535732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.535965] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc8552c2-ca23-4ff6-b3af-1023c397bf96',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.038263] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.038576] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.038666] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.039558] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.039558] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.039558] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port cc8552c2-ca23-4ff6-b3af-1023c397bf96 not found, creating... [ 970.039702] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.039848] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.039983] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.040254] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.040523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.040824] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.041027] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.041506] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.042426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.042426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.042426] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: cc8552c2-ca23-4ff6-b3af-1023c397bf96 is going to be created. [ 970.061719] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.062095] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.062293] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.062696] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.062960] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.063276] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.169949] env[68828]: INFO networking_nsxv3.common.synchronization [req-25e0dbb0-8464-4c20-acbd-57cba3a65117 req-33b69df3-9494-47ad-80cf-329e953cecc3 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 970.170571] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 970.171758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.171758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.171758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.171758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.171758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.171758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.171758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.172113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.172113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.172113] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.674447] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.135875] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-1bda1a5f-705b-465b-a36e-a1dee570d239 service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 971.136143] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-1bda1a5f-705b-465b-a36e-a1dee570d239 service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 971.136214] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-1bda1a5f-705b-465b-a36e-a1dee570d239 service nova] Enqueued Resource ID: cc8552c2-ca23-4ff6-b3af-1023c397bf96 with Priority: HIGHEST for action port [ 971.136435] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 971.136565] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 971.136656] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8552c2-ca23-4ff6-b3af-1023c397bf96 with Priority: HIGHEST for action port [ 971.140915] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.140915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.140915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.140915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.140915] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.141246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.141312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.141575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc8552c2-ca23-4ff6-b3af-1023c397bf96 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.141687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.141748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.141915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.141995] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc8552c2-ca23-4ff6-b3af-1023c397bf96',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.161228] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 971.162078] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 deletion is rescheduled due to dependency. [ 971.162078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.162078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.162276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.162953] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.163129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.163129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.163334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.164273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.164396] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.176907] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.414965] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.414965] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.414965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.414965] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.646317] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.646544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.646871] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc8552c2-ca23-4ff6-b3af-1023c397bf96 with status ACTIVE [ 971.647172] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.647384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.647506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.647828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.647964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.648260] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.648455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.648542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.648789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.648937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.649237] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.649452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.649710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.649782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.649872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.649991] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc8552c2-ca23-4ff6-b3af-1023c397bf96 is going to be updated. [ 971.666681] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.670812] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.671074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.671157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.671371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.671492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.671654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc8552c2-ca23-4ff6-b3af-1023c397bf96" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.681056] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.681212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.681268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.681788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.681788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.681788] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 971.712225] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.712315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.712352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.716024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.716024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.734547] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 971.919048] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.171520] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.316834] env[68828]: INFO networking_nsxv3.common.synchronization [req-227fee6f-30a3-4448-9dd6-87f8d61fd133 req-a0617582-5419-4adc-b98c-0633ec2b3c96 tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 972.318629] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 972.318629] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.318629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.318629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.318838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.318870] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.318982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.322461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.322461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.322461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.322461] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.353675] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-5 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.354046] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.354329] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.354720] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.355204] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.355432] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.355610] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.355984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.356771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.357098] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.357763] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.357763] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.357763] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.357763] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.357763] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.358033] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.376341] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.376598] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.376776] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.377017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.377519] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-0f0779e3-b0d1-4942-bedc-7d9968c65cef taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.377750] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.377888] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.378262] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.378438] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f0779e3-b0d1-4942-bedc-7d9968c65cef',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.420936] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.673044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.673044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.673044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.673419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.673629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.674108] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 972.707814] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.708251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.709021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.709021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.709021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.718118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 972.826133] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.888187] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.888187] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 0f0779e3-b0d1-4942-bedc-7d9968c65cef not found, creating... [ 972.888187] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.888187] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.888932] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.888932] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.889341] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.889830] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.890391] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.890885] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 0f0779e3-b0d1-4942-bedc-7d9968c65cef is going to be created. [ 972.919878] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.919878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.919878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.919878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.919878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.919878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.926615] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.926615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.926615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.926903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.926903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.926980] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 972.960143] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.960314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.960314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.960536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.960768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.975426] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 973.328055] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.749946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 973.749946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.830121] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-47fca3ab-7fe4-47cd-9765-184660700e4d service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 973.830327] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-47fca3ab-7fe4-47cd-9765-184660700e4d service nova] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 973.830574] env[68828]: INFO networking_nsxv3.common.synchronization [req-d67dfeb7-bd16-43eb-9cb3-9e6d20cee2e3 req-47fca3ab-7fe4-47cd-9765-184660700e4d service nova] Enqueued Resource ID: 0f0779e3-b0d1-4942-bedc-7d9968c65cef with Priority: HIGHEST for action port [ 973.830933] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.831564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.831681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.833153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.833153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.833153] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 973.834438] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_rules [ 973.834627] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 973.834762] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f0779e3-b0d1-4942-bedc-7d9968c65cef with Priority: HIGHEST for action port [ 973.835146] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.835278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.835532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.835639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.835877] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f0779e3-b0d1-4942-bedc-7d9968c65cef taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.836026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.836249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.836571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.836571] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f0779e3-b0d1-4942-bedc-7d9968c65cef',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.864883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.865136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.865466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.865726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.865922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.877607] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 974.338546] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f0779e3-b0d1-4942-bedc-7d9968c65cef with status ACTIVE [ 974.341064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.341064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.341064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.341064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.341064] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f0779e3-b0d1-4942-bedc-7d9968c65cef is going to be updated. [ 974.348403] env[68828]: INFO networking_nsxv3.common.synchronization [req-15df2f1b-da97-4abc-9168-c99de745bf06 req-eabeb2dd-4351-4b5b-b94d-a6dd03291cb7 tempest-InstanceActionsNegativeTestJSON-60385423 tempest-InstanceActionsNegativeTestJSON-60385423-project-member] Enqueued Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_members [ 974.348924] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGHEST for action security_group_members [ 974.349275] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.349386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.349448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.349612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.349758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.349851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.349930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.350724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.351128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.351128] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.360238] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.360384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.360439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.360624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.360753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.360909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f0779e3-b0d1-4942-bedc-7d9968c65cef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.729794] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.729794] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.729794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.729794] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.853980] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.854374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.854462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.854715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.854819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.855280] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.855539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.855634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.855824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.855936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.856879] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 is going to be updated. [ 974.880197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.880497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.880644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.880925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.881239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.889011] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 in Status: IN_PROGRESS for 2s [ 974.987548] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.987548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.987548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.987548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.988138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.988138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.988138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.988315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.988375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.988410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.988538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.988615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.988698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.988788] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.231461] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.490704] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826410a3-2e17-4f39-bb2e-9ab8ef871c84: rpc.has_security_group_logging(os_id): False [ 975.512168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.512434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.512434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.512650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.512754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.513049] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.513152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.513235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.513394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.513488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.513685] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.513783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.513878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.518915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.518915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.518915] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.518915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.518915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.518915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.518915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.518915] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 975.562230] env[68828]: INFO networking_nsxv3.common.synchronization [req-e1866eed-d4db-483d-bfe1-e446c651cdf4 req-c8cbe9bc-35ce-4012-8df5-9e2b6c44923d tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 975.562968] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 975.563817] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.563989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.564113] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.566178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.566435] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.566742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.566851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.567117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.567244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.567522] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.575684] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.575684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.575684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.575684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.575684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.580247] env[68828]: INFO networking_nsxv3.common.synchronization [req-305686f6-3cb7-4ce9-8d90-a39c51d5f3bd req-eb02d58b-28ce-40e5-982b-43c50da05e88 tempest-ServersTestBootFromVolume-617483818 tempest-ServersTestBootFromVolume-617483818-project-member] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_members [ 975.580827] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGHEST for action security_group_members [ 975.582033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.582297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.582373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.582565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.582726] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.582875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.582946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.583135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.583221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.583311] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.591520] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 975.733517] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.887046] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 975.887046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.069868] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.070090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.070660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.070660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.070660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.070832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.070946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.071027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.071248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.071347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.071458] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 976.085641] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.085880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.085880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.086143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.107431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.107698] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.107864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.107955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.108125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.108221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.108316] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 is going to be updated. [ 976.110230] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.110407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.110407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.110645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.111390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.125277] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 976.143075] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.143409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.143521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.143745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.143996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.153068] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d08e462e-e8d3-4628-bfb2-6725e011db83 in Status: IN_PROGRESS for 2s [ 976.237481] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.237481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.237481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.237481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.237481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.237481] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 976.262613] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.262973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.262973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.263224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.263304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.273920] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 976.903589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 in Status: SUCCESS [ 976.903589] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 deletion is rescheduled due to dependency. [ 976.903589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.604432] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 977.604666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.604801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.605061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.605136] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.107362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.107894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.107894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.108196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.108446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.108586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.108668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.108863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.108968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.109110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.109179] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.137328] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 978.137525] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 deletion is rescheduled due to dependency. [ 978.137648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.161182] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d08e462e-e8d3-4628-bfb2-6725e011db83 in Status: SUCCESS [ 978.161316] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 deletion is rescheduled due to dependency. [ 978.161489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.283209] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 978.283935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.283935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.283935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.283935] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.284271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.284271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.284337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.284740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.284740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.284740] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.285410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.285608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.285747] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.285873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.285908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.286256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.286330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.286485] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.359027] env[68828]: INFO networking_nsxv3.common.synchronization [req-56830abb-3fd4-461e-90fa-db533bd0ed37 req-ef01951c-d228-422a-a607-615cbd89fdae tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_members [ 978.359027] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGHEST for action security_group_members [ 978.359027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.359732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.359802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.360232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.360614] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.360781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.360914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.361155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.361243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.362475] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.613392] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.613392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.613392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.613392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.613392] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.613392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.613392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.613392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.613891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.613891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.613891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.613891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.613891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.614061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.614234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.614302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.614343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.614548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.614548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.614666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.614751] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.788706] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.789068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.789265] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.864918] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.865266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.865397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.865646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.865825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.866154] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.866408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.866507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.866780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.866996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.867168] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 is going to be updated. [ 978.904308] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.904550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.904722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.904986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.905501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.918203] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 in Status: IN_PROGRESS for 2s [ 979.118491] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 826410a3-2e17-4f39-bb2e-9ab8ef871c84: rpc.has_security_group_logging(os_id): False [ 979.136245] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.136397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.136397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.136642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.136744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.136985] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.137098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.137163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.137324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.137411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.137589] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.137694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.137743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.137872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.137949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.138143] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.138243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.138295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.139479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.139479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.139479] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 979.205364] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.206789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.206789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.209064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.209064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.235322] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 979.292995] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.795374] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.795517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.795517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.795814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.795814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.795994] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 979.824612] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.824807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.824807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.825066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.825182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.836213] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 980.813929] env[68828]: INFO networking_nsxv3.common.synchronization [req-710e012b-033c-4e92-959a-b044a939b40c req-3c157990-1b1e-48cb-8ffb-7979168171a6 tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 980.813929] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 980.813929] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813929] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.813929] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.929296] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 in Status: SUCCESS [ 980.929642] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 deletion is rescheduled due to dependency. [ 980.929726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.974147] env[68828]: INFO networking_nsxv3.common.synchronization [req-55c1b2ae-9bdb-4de2-af34-07726612ce2a req-171232aa-33e7-4e4a-93e7-22936a1702fa tempest-MultipleCreateTestJSON-1707616881 tempest-MultipleCreateTestJSON-1707616881-project-member] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 980.976205] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGHEST for action security_group_members [ 980.977376] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.977376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.175948] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6edb0681-3169-4394-9a4d-7a87526ec63f None None] Enqueued Resource ID: 74caa045-456b-4752-a252-f8fbbcf901df with Priority: HIGHEST for action port [ 981.177637] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74caa045-456b-4752-a252-f8fbbcf901df with Priority: HIGHEST for action port [ 981.178623] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-74caa045-456b-4752-a252-f8fbbcf901df taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.178793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74caa045-456b-4752-a252-f8fbbcf901df" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.178956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74caa045-456b-4752-a252-f8fbbcf901df" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.179400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74caa045-456b-4752-a252-f8fbbcf901df" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.179529] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74caa045-456b-4752-a252-f8fbbcf901df',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.257947] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 981.258240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.319805] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.432451] env[68828]: INFO networking_nsxv3.common.synchronization [req-e37df073-94e6-4f93-ae8d-96e13add7a4f req-4fd303c1-3b99-48f9-8323-b6be3d680f9b tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 981.432659] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 981.433308] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.433462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.433508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.433721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.433879] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.433996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.434105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.434270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.434365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.434531] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.682080] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74caa045-456b-4752-a252-f8fbbcf901df [ 981.682335] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.682480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.682545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.682899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.683109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.683241] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74caa045-456b-4752-a252-f8fbbcf901df already deleted. [ 981.683319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74caa045-456b-4752-a252-f8fbbcf901df" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.821620] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.845870] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 981.846024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.846191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.847140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.847140] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.847140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.847140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.847140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.847140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.847140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.847816] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.847816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.847816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.847816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.847816] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.847816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.847816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.848099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.848099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.848099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.848237] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.915785] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.916033] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.916150] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.916456] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.916728] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.916894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.917096] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.917358] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.920425] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.920425] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.920425] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.920425] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.920425] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.920425] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.920425] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.920425] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.935119] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.935119] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.935228] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.935405] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.935745] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-0710067b-780a-45d6-b7ee-a68fa06e88ef taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.935945] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.937062] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.937062] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.937062] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0710067b-780a-45d6-b7ee-a68fa06e88ef',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.937781] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.937892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.937958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.938143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.938224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.938406] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.938512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.938648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.938682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.938749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.938834] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 981.960395] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.960533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.960600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.960866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.960953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.969421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 982.324310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.324492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.324543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.324757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.325032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.325032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 982.352081] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.352257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.352344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.352986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.353180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.354424] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e73ec652-3cf2-4f74-85a7-b281cb693a56: rpc.has_security_group_logging(os_id): False [ 982.362301] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 982.372686] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.373069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.373069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.373182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.373288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.373727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.373727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.373727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.373859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.373965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.374279] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.374459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.374510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.374907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.374907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.375013] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.375080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.375148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.375320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.375399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.375504] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 982.437242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.437408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.437457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.437678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.437827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.441098] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.442307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.442307] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.442623] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 0710067b-780a-45d6-b7ee-a68fa06e88ef not found, creating... [ 982.442828] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.443123] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.443280] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.443726] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.443726] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.443983] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.447017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.447017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.447017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.447017] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.447017] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 0710067b-780a-45d6-b7ee-a68fa06e88ef is going to be created. [ 982.450631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 982.464639] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.464639] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.464825] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.465039] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.465183] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.465419] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.346241] env[68828]: INFO networking_nsxv3.common.synchronization [req-e37df073-94e6-4f93-ae8d-96e13add7a4f req-394e4cd4-8e66-4370-974a-eeaf6e117a9a service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 983.346241] env[68828]: INFO networking_nsxv3.common.synchronization [req-e37df073-94e6-4f93-ae8d-96e13add7a4f req-394e4cd4-8e66-4370-974a-eeaf6e117a9a service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 983.346241] env[68828]: INFO networking_nsxv3.common.synchronization [req-e37df073-94e6-4f93-ae8d-96e13add7a4f req-394e4cd4-8e66-4370-974a-eeaf6e117a9a service nova] Enqueued Resource ID: 0710067b-780a-45d6-b7ee-a68fa06e88ef with Priority: HIGHEST for action port [ 983.346241] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 983.346241] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 983.346241] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0710067b-780a-45d6-b7ee-a68fa06e88ef with Priority: HIGHEST for action port [ 983.346241] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.346241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.346241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.346241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.346241] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.347246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.347246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.347409] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0710067b-780a-45d6-b7ee-a68fa06e88ef taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.347493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.347532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.347659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.347728] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0710067b-780a-45d6-b7ee-a68fa06e88ef',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.825682] env[68828]: INFO networking_nsxv3.common.synchronization [None req-734e9c79-17d6-4e22-9007-5c7af2198ea2 None None] Enqueued Resource ID: d7d865db-9b9f-42b7-9a5f-98b5278ec388 with Priority: HIGHEST for action port [ 983.825682] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d865db-9b9f-42b7-9a5f-98b5278ec388 with Priority: HIGHEST for action port [ 983.825682] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d865db-9b9f-42b7-9a5f-98b5278ec388 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.825682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d865db-9b9f-42b7-9a5f-98b5278ec388" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.825682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d865db-9b9f-42b7-9a5f-98b5278ec388" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.826982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d865db-9b9f-42b7-9a5f-98b5278ec388" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.826982] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d865db-9b9f-42b7-9a5f-98b5278ec388',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.849414] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.849414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.850855] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0710067b-780a-45d6-b7ee-a68fa06e88ef with status ACTIVE [ 983.850968] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.851096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.851166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.851492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.851628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.852114] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.852114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.852114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.852266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.852676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.852985] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.853103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.853169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.853375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.853581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.853697] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0710067b-780a-45d6-b7ee-a68fa06e88ef is going to be updated. [ 983.873405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.873600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.873681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.873914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.874137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.874303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0710067b-780a-45d6-b7ee-a68fa06e88ef" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.985552] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 983.985552] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.985552] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.985552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.985552] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.328946] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7d865db-9b9f-42b7-9a5f-98b5278ec388 [ 984.329082] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.329206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.329285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.329559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.329643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.329788] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7d865db-9b9f-42b7-9a5f-98b5278ec388 already deleted. [ 984.329894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d865db-9b9f-42b7-9a5f-98b5278ec388" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.372496] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 984.372777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.372869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.373214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.373446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.373576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.373684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.373880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.373998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.374138] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.464338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 984.464338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.465446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.465528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.465603] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.490219] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.876799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.877694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.877694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.877694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.877694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.877914] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.877914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.877914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.878139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.878228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.878345] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be updated. [ 984.901564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.901750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.901839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.902326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.902326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.910380] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: IN_PROGRESS for 2s [ 984.971310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.971484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.971579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.971800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.972023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.972153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.972210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.972374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.972462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.972556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.972689] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.993400] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.354055] env[68828]: INFO networking_nsxv3.common.synchronization [req-b08518c1-972e-4447-9df5-ec53eafea946 req-83ffd2af-fd36-488c-bb77-0e44bc2227e3 tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 985.355336] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 985.355336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.355336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.355336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.355336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.355534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.355534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.355622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.355713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.355791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.356147] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.474741] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.475103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.495322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.495477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.495548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.495766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.495856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.495961] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 985.521592] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.521733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.521839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.522016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.522167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.531525] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 985.537291] env[68828]: INFO networking_nsxv3.common.synchronization [req-b08518c1-972e-4447-9df5-ec53eafea946 req-95bda6c4-6914-4c3e-b1ec-e5e23f50f69c tempest-ServersTestMultiNic-741367989 tempest-ServersTestMultiNic-741367989-project-member] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 985.537807] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGHEST for action security_group_members [ 985.538122] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.538226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.857697] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.953142] env[68828]: INFO networking_nsxv3.common.synchronization [req-b7fa8d8c-0507-45dd-b42a-0c423de0cac8 req-28311d84-03da-4323-9753-a940251eaa8f tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_members [ 985.953142] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGHEST for action security_group_members [ 985.953142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.953142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.953142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.953142] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.339215] env[68828]: INFO networking_nsxv3.common.synchronization [req-a30d4923-ece9-4782-9c2f-4dd3746366b1 req-62a89f40-6d09-4abf-9b23-154e744a4435 tempest-ServersTestJSON-438167534 tempest-ServersTestJSON-438167534-project-member] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_members [ 986.339215] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_members [ 986.339215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.339215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.339215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.339215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.339215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.339215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.339215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.340534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.340756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.340995] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.360898] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.455098] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.455098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.455098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.455098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.476522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.476522] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.476522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.476522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.476522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.476522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.476522] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 is going to be updated. [ 986.508788] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.508933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.508994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.509223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.509368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.518866] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: IN_PROGRESS for 2s [ 986.785689] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.785829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-607" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.785952] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-607" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.786333] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-607" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.786596] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.786757] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.786883] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.787116] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.787264] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.787474] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.787586] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.787695] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.787806] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.787916] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.788035] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.788169] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.813927] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.814222] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.814435] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.815201] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-607" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.815201] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-12cc8759-7ffe-45ba-bda5-35193027dade taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.815439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.815574] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.816020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.816122] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12cc8759-7ffe-45ba-bda5-35193027dade',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.847696] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.847871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.847943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.848148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.848285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.848423] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.848519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.848602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.848714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.848782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.848864] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffdab8-bf16-471f-9412-c5026034844d already deleted. [ 986.848946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.864023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.864023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.864023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.864023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.864023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.864023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 986.895041] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.895259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.895354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.895601] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.895746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.907383] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 986.920427] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 in Status: SUCCESS [ 986.920687] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 deletion is rescheduled due to dependency. [ 986.920750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.318197] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.318523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.318665] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.318954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.319135] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.319303] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 12cc8759-7ffe-45ba-bda5-35193027dade not found, creating... [ 987.319786] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.319977] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.320134] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.320381] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.320531] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.320831] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.321064] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.321287] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.321459] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.321809] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.321809] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 12cc8759-7ffe-45ba-bda5-35193027dade is going to be created. [ 987.340728] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.341053] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.341224] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.341512] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.341753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.341987] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.542084] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.542084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.542084] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.048827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.049054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.049152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.049392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.051120] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.051120] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.051120] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.051120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.052170] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.300835] env[68828]: INFO networking_nsxv3.common.synchronization [req-a30d4923-ece9-4782-9c2f-4dd3746366b1 req-f1e3fe7d-3be4-4dfd-8a04-74a379700ad5 service nova] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_rules [ 988.301518] env[68828]: INFO networking_nsxv3.common.synchronization [req-a30d4923-ece9-4782-9c2f-4dd3746366b1 req-f1e3fe7d-3be4-4dfd-8a04-74a379700ad5 service nova] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_members [ 988.301708] env[68828]: INFO networking_nsxv3.common.synchronization [req-a30d4923-ece9-4782-9c2f-4dd3746366b1 req-f1e3fe7d-3be4-4dfd-8a04-74a379700ad5 service nova] Enqueued Resource ID: 12cc8759-7ffe-45ba-bda5-35193027dade with Priority: HIGHEST for action port [ 988.303566] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_rules [ 988.303762] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_members [ 988.303971] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12cc8759-7ffe-45ba-bda5-35193027dade with Priority: HIGHEST for action port [ 988.304419] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.304633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.304759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.305108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.305241] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.306367] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.308681] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.308681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.308681] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.308681] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-12cc8759-7ffe-45ba-bda5-35193027dade taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.309202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.309202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.310269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.310269] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12cc8759-7ffe-45ba-bda5-35193027dade',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.379293] env[68828]: INFO networking_nsxv3.common.synchronization [req-b5b6cee4-f519-42c4-a581-9e8fcbd914ab req-ff001b7c-6f31-4280-9812-6e2ba678408f tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_members [ 988.381095] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_members [ 988.381095] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.381095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.381095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.381095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.381095] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.381639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.381639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.381639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.381639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.381639] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.527529] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 in Status: SUCCESS [ 988.527711] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 deletion is rescheduled due to dependency. [ 988.527844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.558348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fb8087b-3cde-4101-b157-953a51b3561f: rpc.has_security_group_logging(os_id): False [ 988.575022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.575022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.575022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.575022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.575660] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.575660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.575660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.575660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.575660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.575894] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 988.635190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.635190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.635190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.635190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.635190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.645928] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 988.785439] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.785439] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.785563] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.785794] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.786072] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.786238] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.786359] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.786581] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.786724] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.786939] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.787069] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.787185] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.787298] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.787413] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.787522] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.787657] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.807863] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.810152] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.810152] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.810152] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.810152] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c2b537d3-a44a-48ee-8020-03447a7e886e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.810152] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.810152] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.810152] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.810152] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b537d3-a44a-48ee-8020-03447a7e886e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.811261] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.811261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.811409] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12cc8759-7ffe-45ba-bda5-35193027dade with status ACTIVE [ 988.811482] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.811545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.811614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.811778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.811867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.812040] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.812132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.812188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.812331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.812406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.812575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.812664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.812724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.812861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.812972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.813064] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12cc8759-7ffe-45ba-bda5-35193027dade is going to be updated. [ 988.814068] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.885036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.885036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.885036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.885284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.885284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.885487] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.885661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.885767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.885848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.885938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.886504] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 already deleted. [ 988.886504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.909615] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.909756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.909813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.913021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.913021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.913021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12cc8759-7ffe-45ba-bda5-35193027dade" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.918424] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 988.918618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.919169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.919371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.919557] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.919666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.919729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.919910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.920044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.920138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.920328] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.920408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.920479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.920635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.920779] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.920881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.920941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.921115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.921194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.921274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.921372] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.922213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.922425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.922591] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.922699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.922761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.922946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.923063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.923304] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.311955] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.312331] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.312539] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.312944] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.313197] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.313415] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c2b537d3-a44a-48ee-8020-03447a7e886e not found, creating... [ 989.313707] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.313879] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.314137] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.314272] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.314418] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.314710] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.314862] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.314984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.315234] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.315673] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.315673] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c2b537d3-a44a-48ee-8020-03447a7e886e is going to be created. [ 989.316840] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.334709] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.334947] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.335086] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.335390] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.335620] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.335851] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.424730] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e73ec652-3cf2-4f74-85a7-b281cb693a56: rpc.has_security_group_logging(os_id): False [ 989.427515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.427586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.427586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.428127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.428127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.428127] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.429724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.429724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.429724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.429724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.429724] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 989.440154] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.440289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.440360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.440664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.440762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.440971] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.441083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.441140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.441294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.441348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.441512] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.441586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.441636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.441779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.441853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.442059] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.442217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.442217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.442340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.442408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.442509] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be updated. [ 989.452203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.452354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.452399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.452583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.452716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.459199] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 989.512058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.512058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.512058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.512058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.512058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.526281] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: IN_PROGRESS for 2s [ 989.820415] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.820415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.820759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.820759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.820759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.820941] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffdab8-bf16-471f-9412-c5026034844d is going to be created. [ 989.843511] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.843682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.843772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.844036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.844300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.853438] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffdab8-bf16-471f-9412-c5026034844d in Status: UNINITIALIZED for 2s [ 990.462086] env[68828]: INFO networking_nsxv3.common.synchronization [req-b5b6cee4-f519-42c4-a581-9e8fcbd914ab req-70fa0065-aa6f-436b-81ee-45c3f517692c service nova] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_rules [ 990.462410] env[68828]: INFO networking_nsxv3.common.synchronization [req-b5b6cee4-f519-42c4-a581-9e8fcbd914ab req-70fa0065-aa6f-436b-81ee-45c3f517692c service nova] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_members [ 990.462561] env[68828]: INFO networking_nsxv3.common.synchronization [req-b5b6cee4-f519-42c4-a581-9e8fcbd914ab req-70fa0065-aa6f-436b-81ee-45c3f517692c service nova] Enqueued Resource ID: c2b537d3-a44a-48ee-8020-03447a7e886e with Priority: HIGHEST for action port [ 990.463372] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_rules [ 990.463534] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_members [ 990.463744] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b537d3-a44a-48ee-8020-03447a7e886e with Priority: HIGHEST for action port [ 990.465510] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.465510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.465676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.465892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.465892] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.467945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.467945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.467945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.467945] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.469091] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2b537d3-a44a-48ee-8020-03447a7e886e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.469207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.469384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.469418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.469524] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b537d3-a44a-48ee-8020-03447a7e886e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.658889] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 990.659162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.971587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.972684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.972987] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.977155] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2b537d3-a44a-48ee-8020-03447a7e886e with status ACTIVE [ 990.977155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.977155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.977155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.977155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.977821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.977821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.977821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.977821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.977821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.978114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.978114] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.978201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.978201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.978437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.978437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.978564] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2b537d3-a44a-48ee-8020-03447a7e886e is going to be updated. [ 991.000276] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.001512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.001512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.001512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.001512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.002424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2b537d3-a44a-48ee-8020-03447a7e886e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.470444] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 991.470628] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 deletion is rescheduled due to dependency. [ 991.470746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.476897] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.542832] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 in Status: SUCCESS [ 991.543309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.863068] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffdab8-bf16-471f-9412-c5026034844d in Status: SUCCESS [ 991.863539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.863875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.864279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.864824] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.866101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.866101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.866101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.866101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.866101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.866101] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.980106] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.985229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.985229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.985229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.985229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.985229] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 is going to be created. [ 992.006388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.006388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.006388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.006682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.006770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.015082] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 in Status: UNINITIALIZED for 2s [ 992.152027] env[68828]: INFO networking_nsxv3.common.synchronization [req-6b23f851-ebac-4389-b554-f1df01c52838 req-104ba5b2-4429-48d7-a674-00a704fded21 tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 992.152027] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 992.152027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.152027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.152027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.152027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.153305] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.153645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.153986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.154461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.154742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.155293] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.176852] env[68828]: INFO networking_nsxv3.common.synchronization [None req-329c0ab5-3cda-48d0-a4ea-c7f901d557cd None None] Enqueued Resource ID: 802aeeb7-8a21-4519-828a-bf53517a8c5b with Priority: HIGHEST for action port [ 992.177505] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802aeeb7-8a21-4519-828a-bf53517a8c5b with Priority: HIGHEST for action port [ 992.177649] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-802aeeb7-8a21-4519-828a-bf53517a8c5b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.177771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-802aeeb7-8a21-4519-828a-bf53517a8c5b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.177831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-802aeeb7-8a21-4519-828a-bf53517a8c5b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.178095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-802aeeb7-8a21-4519-828a-bf53517a8c5b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.178177] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802aeeb7-8a21-4519-828a-bf53517a8c5b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.370027] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.658671] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.659101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.659266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.659602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.659764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.660065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.660225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.660301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.660541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.662953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.662953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 992.680030] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 802aeeb7-8a21-4519-828a-bf53517a8c5b [ 992.680307] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.680465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.680534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.680764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.680923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.681045] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:802aeeb7-8a21-4519-828a-bf53517a8c5b already deleted. [ 992.681130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-802aeeb7-8a21-4519-828a-bf53517a8c5b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.686164] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.686251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.686251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.686470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.686661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.694599] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 992.873708] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14ffdab8-bf16-471f-9412-c5026034844d: rpc.has_security_group_logging(os_id): False [ 992.891354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.891569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.891625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.893022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.893022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.893022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.893022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.893022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.893022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.893022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.893022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ffdab8-bf16-471f-9412-c5026034844d is going to be created. [ 992.946908] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.947089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.947133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.947354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.947527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.958808] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ffdab8-bf16-471f-9412-c5026034844d in Status: IN_PROGRESS for 2s [ 994.027895] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 in Status: SUCCESS [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.027895] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.027895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.027895] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.128970] env[68828]: INFO networking_nsxv3.common.synchronization [None req-06d84d23-0ed2-409d-a5f8-bb58e8dfd845 None None] Enqueued Resource ID: b1e6516d-2e63-4692-943b-5ebcd875f77f with Priority: HIGHEST for action port [ 994.129252] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1e6516d-2e63-4692-943b-5ebcd875f77f with Priority: HIGHEST for action port [ 994.130436] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1e6516d-2e63-4692-943b-5ebcd875f77f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.130436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1e6516d-2e63-4692-943b-5ebcd875f77f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.132583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1e6516d-2e63-4692-943b-5ebcd875f77f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.132583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1e6516d-2e63-4692-943b-5ebcd875f77f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.132583] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1e6516d-2e63-4692-943b-5ebcd875f77f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.531893] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.635606] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1e6516d-2e63-4692-943b-5ebcd875f77f [ 994.635850] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.635999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.636101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.636314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.636403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.636499] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1e6516d-2e63-4692-943b-5ebcd875f77f already deleted. [ 994.636581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1e6516d-2e63-4692-943b-5ebcd875f77f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.709102] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 4s [ 994.972039] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ffdab8-bf16-471f-9412-c5026034844d in Status: SUCCESS [ 994.973321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.039266] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a27e33a-25e2-461a-8cee-d5aba5ff9550: rpc.has_security_group_logging(os_id): False [ 995.056628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.056628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.056628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.056874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.057185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.057410] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.057410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.058159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.058159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.058159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.058159] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 is going to be created. [ 995.110789] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.110984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.111100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.111333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.111534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.120719] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 in Status: IN_PROGRESS for 2s [ 996.720992] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 996.720992] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 996.721381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.136280] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 in Status: SUCCESS [ 997.136501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.488980] env[68828]: INFO networking_nsxv3.common.synchronization [req-37fa8b9f-daf7-497f-8d89-ef4207ca2740 req-58f13040-c571-4c8e-9da9-55f16ff88260 tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 998.489457] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 998.489815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.490029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.490155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.490774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.490774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.491140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.491140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.491901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.491901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.491901] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.746177] env[68828]: INFO networking_nsxv3.common.synchronization [None req-95bc5dc2-e4f2-42b8-8694-de577647f81e None None] Enqueued Resource ID: e71bb5cb-11c9-4311-8fbe-a96df23d8930 with Priority: HIGHEST for action port [ 998.746809] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71bb5cb-11c9-4311-8fbe-a96df23d8930 with Priority: HIGHEST for action port [ 998.747097] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e71bb5cb-11c9-4311-8fbe-a96df23d8930 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.747233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e71bb5cb-11c9-4311-8fbe-a96df23d8930" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.747305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e71bb5cb-11c9-4311-8fbe-a96df23d8930" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.747583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e71bb5cb-11c9-4311-8fbe-a96df23d8930" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.747719] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e71bb5cb-11c9-4311-8fbe-a96df23d8930',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.898333] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.898925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.898925] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.899073] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.900041] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.900041] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.900041] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.900041] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.900041] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.900293] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.900412] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.900534] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.900652] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.900772] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.900945] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.901220] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.926430] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.926430] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.926430] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.926430] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-911" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.926430] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-9521bfc7-1185-47d5-b11d-40eed81783e1 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.926430] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.926430] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.926430] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.927011] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9521bfc7-1185-47d5-b11d-40eed81783e1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.994257] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.994405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.994476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.994694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.994786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.994979] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.995110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.995162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.995322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.995396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.995467] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 999.022133] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.022133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.022133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.022133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.022133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.027852] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 999.251384] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e71bb5cb-11c9-4311-8fbe-a96df23d8930 [ 999.251646] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.251751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.251833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.252516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.252555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.252655] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e71bb5cb-11c9-4311-8fbe-a96df23d8930 already deleted. [ 999.252751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e71bb5cb-11c9-4311-8fbe-a96df23d8930" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.430383] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.430619] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.430753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.431106] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.431282] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.431447] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 9521bfc7-1185-47d5-b11d-40eed81783e1 not found, creating... [ 999.431759] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.431933] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.432072] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.432317] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.432455] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.432738] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.432900] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.433104] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.433346] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.433490] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.433656] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 9521bfc7-1185-47d5-b11d-40eed81783e1 is going to be created. [ 999.455467] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.455702] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.455828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.456126] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.456372] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.456605] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.997072] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d9a87255-52b9-4e12-ad87-69b4cd1cba23 tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 999.997589] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 999.997973] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.000121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.000121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.000355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.000610] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.207534] env[68828]: INFO networking_nsxv3.common.synchronization [None req-357cf5bd-575e-4307-ab02-4f49aa24df6c tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1000.207534] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1000.209701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.210261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.471727] env[68828]: INFO networking_nsxv3.common.synchronization [req-37fa8b9f-daf7-497f-8d89-ef4207ca2740 req-9e70f369-67c5-44b0-ad89-d386393dd7a1 service nova] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_rules [ 1000.471910] env[68828]: INFO networking_nsxv3.common.synchronization [req-37fa8b9f-daf7-497f-8d89-ef4207ca2740 req-9e70f369-67c5-44b0-ad89-d386393dd7a1 service nova] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 1000.472103] env[68828]: INFO networking_nsxv3.common.synchronization [req-37fa8b9f-daf7-497f-8d89-ef4207ca2740 req-9e70f369-67c5-44b0-ad89-d386393dd7a1 service nova] Enqueued Resource ID: 9521bfc7-1185-47d5-b11d-40eed81783e1 with Priority: HIGHEST for action port [ 1000.472573] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_rules [ 1000.472672] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 1000.472921] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9521bfc7-1185-47d5-b11d-40eed81783e1 with Priority: HIGHEST for action port [ 1000.473149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.473277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.473373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.474325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.474325] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.474577] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.474744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.474869] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9521bfc7-1185-47d5-b11d-40eed81783e1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.474986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.475296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.475296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.475296] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9521bfc7-1185-47d5-b11d-40eed81783e1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.523239] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.523239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.523239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.523239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.523239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.523239] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd already deleted. [ 1000.523239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.523764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.523764] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.523764] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.807573] env[68828]: INFO networking_nsxv3.common.synchronization [None req-2f3d09f5-e0a3-49d2-9245-35c230236ffb None None] Enqueued Resource ID: c5386d74-479f-4f43-831d-f7a3845e3252 with Priority: HIGHEST for action port [ 1000.807823] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5386d74-479f-4f43-831d-f7a3845e3252 with Priority: HIGHEST for action port [ 1000.808503] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5386d74-479f-4f43-831d-f7a3845e3252 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.808570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5386d74-479f-4f43-831d-f7a3845e3252" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.808632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5386d74-479f-4f43-831d-f7a3845e3252" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.808885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5386d74-479f-4f43-831d-f7a3845e3252" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.808969] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5386d74-479f-4f43-831d-f7a3845e3252',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.976993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.977215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.979523] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9521bfc7-1185-47d5-b11d-40eed81783e1 with status ACTIVE [ 1000.979718] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.979843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.979914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.980163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.980258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.980442] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.980543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.980605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.980752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.980831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.981040] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.981144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.981208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.981349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.981426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.981513] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9521bfc7-1185-47d5-b11d-40eed81783e1 is going to be updated. [ 1001.009591] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.009591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.009591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.009591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.009591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.009591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9521bfc7-1185-47d5-b11d-40eed81783e1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.057035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.057559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.057766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.057989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.058184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.058184] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd already deleted. [ 1001.058470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.059035] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 1001.059199] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 deletion is rescheduled due to dependency. [ 1001.059319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.059471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.059609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.059783] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.060037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.060037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.062451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.062451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.062451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.312720] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5386d74-479f-4f43-831d-f7a3845e3252 [ 1001.312883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.312883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.313077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.313224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.313322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.313422] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5386d74-479f-4f43-831d-f7a3845e3252 already deleted. [ 1001.313589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5386d74-479f-4f43-831d-f7a3845e3252" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.567351] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.990270] env[68828]: INFO networking_nsxv3.common.synchronization [None req-5ba93711-13d9-43c4-88f3-7429e9511acc tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_rules [ 1001.990613] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_rules [ 1001.990917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.991074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.991146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.991401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.991484] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.066271] env[68828]: INFO networking_nsxv3.common.synchronization [None req-222797ef-4431-48f1-a60b-65f6f3e613e0 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_rules [ 1002.066271] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_rules [ 1002.066271] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.066656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.074588] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.511823] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.511823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.511823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.512056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.512056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.512137] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a already deleted. [ 1002.512204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.512346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.512496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.512578] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.577428] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.577606] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.577776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.577883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.577957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.578402] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 1002.604042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.604217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.604290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.604491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.604631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.612286] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 1003.037074] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.037244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.037312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.037525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.037613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.037673] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a already deleted. [ 1003.037759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.621931] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 1004.622237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.622338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.622507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.622700] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.622814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.622894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.623078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.623164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.623252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.623340] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.129248] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.129533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.129675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.129939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.130180] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.130323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.130379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.130539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.130629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.131375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.131375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.131375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.131375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.131375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.131375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.131835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.131835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.131835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.131835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.131979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.132040] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.633692] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33e63aa4-edf9-4cdd-b540-1791bfdc42d4: rpc.has_security_group_logging(os_id): False [ 1005.650957] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.651223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.651300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.651490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.651579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.651812] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.651915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.652754] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.652754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.653371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.653371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.653371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.653371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.653371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.653371] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 1005.709086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.709274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.709318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.709527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.709671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.738954] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 1006.828955] env[68828]: INFO networking_nsxv3.common.synchronization [req-d43c2eab-b783-44ec-acad-1be934e7d623 req-f69984fd-4f20-4d9a-9634-d8086b8346fd tempest-ServerMetadataTestJSON-384342819 tempest-ServerMetadataTestJSON-384342819-project-member] Enqueued Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_members [ 1006.829500] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_members [ 1006.829803] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.829924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.829993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.830288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.830443] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.830591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.830670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.830818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.830941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.831047] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.333312] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.333486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.334341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.334341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.334341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.334341] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.334341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.334341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.334661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.334661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.334661] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ad64928-35ab-4360-b3b2-a74c9841860d already deleted. [ 1007.334768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.487151] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.487437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.487532] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.487856] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.488144] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.488310] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.488433] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.488659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.488813] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.489035] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.489160] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.489309] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.489428] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.489571] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.489702] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.489842] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.507986] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.508194] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.508339] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.508517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-739" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.508829] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-db3c49fb-981b-449a-9e2c-2513a5274eae taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.509010] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.509188] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.509517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.509663] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3c49fb-981b-449a-9e2c-2513a5274eae',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.751689] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 1007.751689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.914525] env[68828]: INFO networking_nsxv3.common.synchronization [req-afa689cd-ffeb-42b7-b2b3-15ed19043817 req-cd4527b1-7fb0-484b-9857-d428cf1e31ab tempest-ListImageFiltersTestJSON-1716956093 tempest-ListImageFiltersTestJSON-1716956093-project-member] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 1007.914525] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 1007.914525] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.914525] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.914525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.914525] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.012663] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.012890] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.013290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.013431] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.013493] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.013652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port db3c49fb-981b-449a-9e2c-2513a5274eae not found, creating... [ 1008.016232] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.016232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.016232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.016232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.016460] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.016590] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.016918] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.016918] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.017109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.017297] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.017345] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: db3c49fb-981b-449a-9e2c-2513a5274eae is going to be created. [ 1008.036908] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.037054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.037105] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.037319] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.037550] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.037833] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.416140] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.918278] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.237228] env[68828]: INFO networking_nsxv3.common.synchronization [req-d43c2eab-b783-44ec-acad-1be934e7d623 req-0627fe9d-b17b-4732-8f9b-43373a4f4e00 service nova] Enqueued Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_rules [ 1009.237228] env[68828]: INFO networking_nsxv3.common.synchronization [req-d43c2eab-b783-44ec-acad-1be934e7d623 req-0627fe9d-b17b-4732-8f9b-43373a4f4e00 service nova] Enqueued Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_members [ 1009.237228] env[68828]: INFO networking_nsxv3.common.synchronization [req-d43c2eab-b783-44ec-acad-1be934e7d623 req-0627fe9d-b17b-4732-8f9b-43373a4f4e00 service nova] Enqueued Resource ID: db3c49fb-981b-449a-9e2c-2513a5274eae with Priority: HIGHEST for action port [ 1009.237228] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_rules [ 1009.237228] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_members [ 1009.237228] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3c49fb-981b-449a-9e2c-2513a5274eae with Priority: HIGHEST for action port [ 1009.237228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.237228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.237228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.237228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.237228] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.237228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.237228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.237228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.240369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.240539] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.240654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.240724] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.240953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.241151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.241186] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.242146] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-db3c49fb-981b-449a-9e2c-2513a5274eae taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.242304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.242525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.242559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.242615] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3c49fb-981b-449a-9e2c-2513a5274eae',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.420517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.420733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.420784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.420981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.421146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.422022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be updated. [ 1009.445203] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.445375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.445428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.445628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.445765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.453148] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 1009.746101] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.747470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.747470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.749253] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db3c49fb-981b-449a-9e2c-2513a5274eae with status ACTIVE [ 1009.749253] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.749253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.749253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.749253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.749570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.749570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.749570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.749691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.749875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.749980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.750202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.750301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.750389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.750556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.750654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.750758] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db3c49fb-981b-449a-9e2c-2513a5274eae is going to be updated. [ 1009.780567] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.780728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.780804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.781058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.781222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.781403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db3c49fb-981b-449a-9e2c-2513a5274eae" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.249346] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.752927] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.752927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.752927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.752927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.753206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.754089] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ad64928-35ab-4360-b3b2-a74c9841860d is going to be created. [ 1010.782600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.782735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.782799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.782988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.783206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.799568] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ad64928-35ab-4360-b3b2-a74c9841860d in Status: UNINITIALIZED for 2s [ 1011.485125] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 1011.485434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.803735] env[68828]: INFO networking_nsxv3.common.synchronization [req-485df9ea-3846-4fc0-b8af-8089027ed7f8 req-6be30b29-0a02-49d5-8192-3aed3395c156 tempest-ImagesOneServerNegativeTestJSON-2108584551 tempest-ImagesOneServerNegativeTestJSON-2108584551-project-member] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 1011.804360] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGHEST for action security_group_members [ 1011.804667] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.804789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.804897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.806150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.806401] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.807301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.807301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.807301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.807301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.807301] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.458134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.458134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.458134] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be updated. [ 1012.458134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.458134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.460399] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: IN_PROGRESS for 2s [ 1012.808374] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ad64928-35ab-4360-b3b2-a74c9841860d in Status: SUCCESS [ 1012.808374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.808685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.808749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.808939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.809074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.809136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.809291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.809371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.809455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.809543] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.311790] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.311953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.312043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.312271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.312447] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.312550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.312614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.312757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.312844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.312932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.313272] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.313398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.317466] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.317466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.317466] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.818705] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ad64928-35ab-4360-b3b2-a74c9841860d: rpc.has_security_group_logging(os_id): False [ 1013.835606] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.835786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.835861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.836094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.836189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.836451] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.836646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.836749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.836938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.837057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.837281] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.837417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.837500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.837673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.837773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.837995] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.838160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.838246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.838415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.838514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.838621] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ad64928-35ab-4360-b3b2-a74c9841860d is going to be created. [ 1013.893744] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.893907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.893988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.894251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.894438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.904437] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ad64928-35ab-4360-b3b2-a74c9841860d in Status: IN_PROGRESS for 2s [ 1013.909896] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1013.910029] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1014.359633] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 in Status: SUCCESS [ 1014.359818] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 deletion is rescheduled due to dependency. [ 1014.359930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.587677] env[68828]: INFO networking_nsxv3.common.synchronization [req-3b8aa0da-4bef-4be6-91f4-7df307c67db7 req-1744b9f9-cefa-41a9-ab9f-da6339c7044e tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 1014.589076] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 1014.589076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.589076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.589076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.589076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.589076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.589393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.589393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.589393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.589498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.589533] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.023344] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.023639] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.023726] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.023965] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.024295] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.024482] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.024555] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.025172] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.025172] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.026014] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.026174] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.026279] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.026406] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.026529] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.026644] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.026785] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.047090] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.047286] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.047447] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.048956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-446" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.048956] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-1970ba41-aec7-459a-ab33-efb8afae6e73 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.048956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.048956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.048956] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.048956] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1970ba41-aec7-459a-ab33-efb8afae6e73',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.092067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.092389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.092389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.092612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.092720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.092898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.092992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.093071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.093659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.093659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.093659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 1015.120611] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.120611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.120611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.120790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.120863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.130867] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 1015.550685] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.550889] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.551060] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.551426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.551625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.552036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 1970ba41-aec7-459a-ab33-efb8afae6e73 not found, creating... [ 1015.552125] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.552282] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.552337] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.552659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.552733] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.553031] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.553561] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.553561] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.554350] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.554499] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.554673] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 1970ba41-aec7-459a-ab33-efb8afae6e73 is going to be created. [ 1015.573571] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.573707] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.573842] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.574254] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.574345] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.574543] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.915431] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ad64928-35ab-4360-b3b2-a74c9841860d in Status: SUCCESS [ 1015.915675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.692476] env[68828]: INFO networking_nsxv3.common.synchronization [req-3b8aa0da-4bef-4be6-91f4-7df307c67db7 req-09827cb0-b931-4ef1-9edd-9542c902be52 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 1016.692819] env[68828]: INFO networking_nsxv3.common.synchronization [req-3b8aa0da-4bef-4be6-91f4-7df307c67db7 req-09827cb0-b931-4ef1-9edd-9542c902be52 service nova] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 1016.693282] env[68828]: INFO networking_nsxv3.common.synchronization [req-3b8aa0da-4bef-4be6-91f4-7df307c67db7 req-09827cb0-b931-4ef1-9edd-9542c902be52 service nova] Enqueued Resource ID: 1970ba41-aec7-459a-ab33-efb8afae6e73 with Priority: HIGHEST for action port [ 1016.695364] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_rules [ 1016.695715] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 1016.695715] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1970ba41-aec7-459a-ab33-efb8afae6e73 with Priority: HIGHEST for action port [ 1016.695901] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.696050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.696120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.696298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.696374] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.697263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.697372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.700696] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1970ba41-aec7-459a-ab33-efb8afae6e73 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.700833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.700906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.701175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.701302] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1970ba41-aec7-459a-ab33-efb8afae6e73',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.141039] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 1017.141039] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 1017.141039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.141039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.141302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.141441] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.141540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.141608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.141755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.141837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.141933] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.203366] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.203366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.203559] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1970ba41-aec7-459a-ab33-efb8afae6e73 with status ACTIVE [ 1017.203778] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.203914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.203999] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.204282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.204385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.204560] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.204676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.204772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.204996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.205095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.205281] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.205398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.205450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.205567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.205640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.205723] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1970ba41-aec7-459a-ab33-efb8afae6e73 is going to be updated. [ 1017.225805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.225997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.226050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.226244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.226376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.226589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1970ba41-aec7-459a-ab33-efb8afae6e73" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.644075] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.149400] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.652157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.652157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.652157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.652157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.652157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.652157] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 1018.678156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.678156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.678156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.678156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.678770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.686483] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 1019.677234] env[68828]: INFO networking_nsxv3.common.synchronization [req-3f93b449-7383-4ceb-94af-4026306ef288 req-584fb749-b9ce-4e7a-812e-fdd3ffb7d394 tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 1019.677787] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 1019.678101] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.678230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.678310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.678933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.679196] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.679314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.679379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.679613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.679651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.679739] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.774725] env[68828]: INFO networking_nsxv3.common.synchronization [req-b55a5bdb-1ac8-4b88-a1fd-4237a9a10088 req-0aac12c3-92d2-4421-ac87-0ccf145890e6 tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1019.775423] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1019.775833] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.776008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.776117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.776388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.776610] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.776755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.776850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.777078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.777204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.777343] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.125685] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.126114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.126114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.126290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.126553] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.126716] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.126842] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.127077] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.127235] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.127445] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.127568] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.127683] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.127798] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.127911] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.128040] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.128185] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.145045] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.145165] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.145223] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.145436] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.145724] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-8d32c6dc-4446-4efe-a6a8-acc5131ab832 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.145892] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.146030] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.146340] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.146489] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d32c6dc-4446-4efe-a6a8-acc5131ab832',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.184325] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.280851] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.348078] env[68828]: INFO networking_nsxv3.common.synchronization [req-e4532503-1e56-4735-88e0-0a13b908d74f req-fd455161-51c1-4a59-b16a-3349539f145d tempest-ServerMetadataTestJSON-384342819 tempest-ServerMetadataTestJSON-384342819-project-member] Enqueued Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_members [ 1020.348604] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGHEST for action security_group_members [ 1020.348929] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.349073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.349139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.349458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.349533] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.349613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.349676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.349823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.349905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.349997] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.648159] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.648424] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.648543] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.648844] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.649082] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.649266] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 8d32c6dc-4446-4efe-a6a8-acc5131ab832 not found, creating... [ 1020.649545] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.649703] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.649821] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.650065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.650249] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.650539] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.650696] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.650875] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.651195] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.651341] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.651488] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 8d32c6dc-4446-4efe-a6a8-acc5131ab832 is going to be created. [ 1020.671421] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.671640] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.671769] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.672080] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.672293] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.672525] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.686258] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.697802] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 4s [ 1020.784331] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.852090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.852310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.852354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.852549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.852644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.852854] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.852950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.853022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.853315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.853410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.853509] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ad64928-35ab-4360-b3b2-a74c9841860d is going to be updated. [ 1020.888034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.888190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.888261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.888477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.888614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.898761] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ad64928-35ab-4360-b3b2-a74c9841860d in Status: IN_PROGRESS for 2s [ 1021.189604] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.189767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.189842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.190106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.190210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.190348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be updated. [ 1021.224166] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.224166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.224166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.224166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.224166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.232994] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: IN_PROGRESS for 2s [ 1021.286659] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.286659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.286659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.286659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.286659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.286659] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1021.312157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.312375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.312452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.312912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.312912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.321771] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1021.438056] env[68828]: INFO networking_nsxv3.common.synchronization [req-b55a5bdb-1ac8-4b88-a1fd-4237a9a10088 req-a8148f90-f35e-4bbb-8f96-ec6a630a4eb4 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1021.438056] env[68828]: INFO networking_nsxv3.common.synchronization [req-b55a5bdb-1ac8-4b88-a1fd-4237a9a10088 req-a8148f90-f35e-4bbb-8f96-ec6a630a4eb4 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1021.438056] env[68828]: INFO networking_nsxv3.common.synchronization [req-b55a5bdb-1ac8-4b88-a1fd-4237a9a10088 req-a8148f90-f35e-4bbb-8f96-ec6a630a4eb4 service nova] Enqueued Resource ID: 8d32c6dc-4446-4efe-a6a8-acc5131ab832 with Priority: HIGHEST for action port [ 1021.438056] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1021.438056] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1021.438056] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d32c6dc-4446-4efe-a6a8-acc5131ab832 with Priority: HIGHEST for action port [ 1021.438056] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.438056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.438056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.438508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.438508] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.439180] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.439285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.439483] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d32c6dc-4446-4efe-a6a8-acc5131ab832 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.439586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.439650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.439820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.439899] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d32c6dc-4446-4efe-a6a8-acc5131ab832',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.941930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.942247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.942284] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d32c6dc-4446-4efe-a6a8-acc5131ab832 with status ACTIVE [ 1021.942465] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.942571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.942644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.942871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.943925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.943925] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.943925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.943925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.943925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.943925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.943925] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.943925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.944504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.944504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.944504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.944504] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d32c6dc-4446-4efe-a6a8-acc5131ab832 is going to be updated. [ 1021.964636] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.964777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.964847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.965059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.965219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.965372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d32c6dc-4446-4efe-a6a8-acc5131ab832" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.281263] env[68828]: INFO networking_nsxv3.common.synchronization [req-f7f596bf-0bca-40b0-919a-a3e67fd0a08d req-815a3448-2f75-4010-95f6-e699483d2e0f tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1022.281263] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1022.281263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.281263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.281263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.281263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.281263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.281806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.282126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.282438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.282698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.282912] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.620450] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.620624] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.620767] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.621070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.621336] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.621500] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.621621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.622505] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.622702] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.622922] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.623057] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.623208] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.623328] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.623459] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.623809] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.623809] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.640396] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.640606] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.640752] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.640976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.641355] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.641542] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.641669] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.642045] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.642160] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.706323] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 1022.706532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.706703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.706936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.707134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.707292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.707378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.707534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.707617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.707703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.707790] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.785721] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.785880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.785953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.786185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.786282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.786475] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.786572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.786653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.786815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.786892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.786979] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a already deleted. [ 1022.787070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.908063] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ad64928-35ab-4360-b3b2-a74c9841860d in Status: SUCCESS [ 1022.908218] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ad64928-35ab-4360-b3b2-a74c9841860d deletion is rescheduled due to dependency. [ 1022.908333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.145176] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.145176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.145176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.145176] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.145529] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.145529] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 not found, creating... [ 1023.145677] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.145839] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.145977] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.146196] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.146340] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.146611] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.146768] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.146886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.147163] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.147250] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.147393] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 is going to be created. [ 1023.171597] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.171809] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.171939] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.172230] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.172473] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.172676] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.209534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.209705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.209778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.209993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.210202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.210286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.210352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.210533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.210649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.210757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.210918] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.211107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.211167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.211289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.211426] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.211560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.211591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.211704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.211780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.211876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.211948] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.241820] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 1023.242042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.330078] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1023.330323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.330479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.330769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.330976] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.331131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.331211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.331410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.331495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.331615] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.716680] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fdb4832-fb6b-46dc-9929-5e545ccfc219: rpc.has_security_group_logging(os_id): False [ 1023.732973] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.733187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.733234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.733449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.733542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.733824] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.733938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.734016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.734178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.734258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.734450] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.734543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.734604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.734741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.734838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.735165] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.735266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.735328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.735467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.735540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.735626] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 1023.797698] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.797885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.797989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.798292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.798501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.809366] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 1023.833976] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.910317] env[68828]: INFO networking_nsxv3.common.synchronization [req-f7f596bf-0bca-40b0-919a-a3e67fd0a08d req-6ac8a75d-97ca-40bf-97d9-07098fea7b8c service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1023.910495] env[68828]: INFO networking_nsxv3.common.synchronization [req-f7f596bf-0bca-40b0-919a-a3e67fd0a08d req-6ac8a75d-97ca-40bf-97d9-07098fea7b8c service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1023.910675] env[68828]: INFO networking_nsxv3.common.synchronization [req-f7f596bf-0bca-40b0-919a-a3e67fd0a08d req-6ac8a75d-97ca-40bf-97d9-07098fea7b8c service nova] Enqueued Resource ID: 4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 with Priority: HIGHEST for action port [ 1023.910879] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1023.911038] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1023.911166] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 with Priority: HIGHEST for action port [ 1023.911734] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.911882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.911959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.913198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.913335] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.914624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.914706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.914784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.915427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.915593] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.915698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.915757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.915908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.915998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.916406] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.917562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.917772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.917847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.918041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.918152] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.336780] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.415963] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.415963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.418630] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.420141] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 with status ACTIVE [ 1024.420324] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.420571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.420571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.420681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.420793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.420931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.421035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.421160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.421414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.421414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.421604] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.421852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.421852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.421975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.421975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.422140] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03 is going to be updated. [ 1024.440463] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.440592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.440663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.440850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.441015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.441165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ed579f1-42f5-4fc2-96ef-11cc6e5c7d03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.839065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.839261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.839359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.839647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.839781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.839927] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1024.851733] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.851868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.851934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.852142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.852253] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.864174] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.864290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.864326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.864512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.864647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.875677] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1024.921207] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.354675] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.423090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.423090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.423263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.423560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.423693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.423850] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be created. [ 1025.445352] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.445595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.445680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.445884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.446089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.454248] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: UNINITIALIZED for 2s [ 1025.825334] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 1025.828399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.856863] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.359560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1026.359898] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1026.780718] env[68828]: INFO networking_nsxv3.common.synchronization [req-af7f0149-2b3e-474b-a1fc-526579231824 req-92de2d94-1b26-42db-9f05-95d98e2a1b48 tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1026.781234] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1026.781566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.781711] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.781777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.782136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.782302] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.782410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.782476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.782638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.782721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.782813] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.885773] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1026.885773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.885909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.886664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.886664] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.886664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.886664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.886664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.886664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.886896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.886896] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.101280] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.101426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.101504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.101773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.119859] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1027.123766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.123766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1027.150841] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.151068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.151681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.151978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.162767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.163649] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1027.163742] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.163870] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1027.195896] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.196087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.196160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.196446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.197753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.197977] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1027.206957] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.207201] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.207332] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.207658] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.208753] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.208753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.208753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.208753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.208753] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.209113] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.209113] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.209113] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.209207] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.209279] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.209394] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.209531] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.227054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.227248] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.227628] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.227628] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.227927] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-bb953f2f-203c-4718-9352-725e66364027 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.228121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.228246] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.228569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.228713] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb953f2f-203c-4718-9352-725e66364027',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.265812] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.265921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.265921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.266151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.266616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.266673] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1027.285259] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.285762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.285762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.285762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.285762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.286300] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.286300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.286300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.286300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.286466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.286466] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd already deleted. [ 1027.286513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.324573] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.324737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.324959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.325031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.325362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.325722] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1027.325823] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e73ec652-3cf2-4f74-85a7-b281cb693a56', '7f82e204-74c2-4f16-ab6e-65554153de56', 'c3f83419-8dd4-4326-ad0d-7a38e73a74f4', 'd03381a0-8611-467b-849f-03e37e47978c', 'bc128506-c5e7-4179-a805-6679a20e9957', '42ac7969-2394-41c5-ac03-dedae73eb17f', '7ad64928-35ab-4360-b3b2-a74c9841860d', '3fdb4832-fb6b-46dc-9929-5e545ccfc219', '48d51724-5116-4cde-bbe3-36293e35d81b', 'e3520fd5-ed17-4f2b-837a-d2cb4c3d0573', '123868e6-4541-435b-9bd1-c8af4f43c09a', '7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec', 'd6e8b4d0-5c3c-49d7-818c-d81ddf51bc03', 'a8e993f1-ee06-4325-98b9-4dc8467a2fb3', '826410a3-2e17-4f39-bb2e-9ab8ef871c84', '0772c5f0-7902-49dd-8073-f3ce338b4a68', '061e7957-d08e-4436-88e2-d8f6b78364a8', '72dfb289-4716-4f30-92e1-ad6fe6010326', '1c9cd372-4403-4f1e-910f-c55839944672', 'd08e462e-e8d3-4628-bfb2-6725e011db83', '4fb8087b-3cde-4101-b157-953a51b3561f', '309bda50-1db3-47e1-b12b-431331217ccd', '7a27e33a-25e2-461a-8cee-d5aba5ff9550', '44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa', '2f4a4187-5566-42ed-af79-13c7cf7b4577', 'd71fe85b-2b15-476f-8dc2-6739692bced0', 'c55eb713-452e-4803-84ae-58a048b5a359', '14ffdab8-bf16-471f-9412-c5026034844d', '55fbd6f6-2090-4d92-ac03-c7ce1819a7d1', '49bff80d-9c54-4a44-a1a9-f388114a1a64', 'df1d5f70-a74c-42f7-ac16-3a22419f5e48', '6547eb98-d904-4822-951d-00fe16de337d', 'f9050286-eb81-4cbb-9bd8-733baee0e20c', 'e6a0522b-dbc3-42bf-8801-b6e755596373', '7c70394b-e7ce-40e9-946e-b190f72998f8', 'd681bb4b-ff28-46df-b3fb-b660a07ce6c2', '37ec0117-a289-428f-9466-58f2541a90c7', '448a7f6d-e5f6-4ab8-9c7c-330542177864', 'ee881f3c-d61c-4373-931c-252d84c5ac2b', '33e63aa4-edf9-4cdd-b540-1791bfdc42d4', '0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff', 'e9f41e17-e083-4115-b3db-6fcd432d4982'} {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.325913] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1027.342554] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.342695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.342775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.343069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.343125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.343988] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1027.343988] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.343988] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1027.389167] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.389477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.389477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.389663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.389774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.390071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.390145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.390307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.390393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.390723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.390723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.390723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.390893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.390893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.391028] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.391122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.391193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.391341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.391394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.391457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.391540] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.407688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.407809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.407886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.408081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.408997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.409249] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1027.409333] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1027.409403] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1027.409470] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1027.409546] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1027.409616] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGH for action security_group_rules [ 1027.409691] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGH for action security_group_rules [ 1027.409757] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGH for action security_group_rules [ 1027.409818] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGH for action security_group_rules [ 1027.409882] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGH for action security_group_rules [ 1027.409942] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGH for action security_group_rules [ 1027.410010] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGH for action security_group_rules [ 1027.410081] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGH for action security_group_rules [ 1027.410142] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGH for action security_group_rules [ 1027.410204] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGH for action security_group_rules [ 1027.410265] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGH for action security_group_rules [ 1027.410326] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGH for action security_group_rules [ 1027.410386] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGH for action security_group_rules [ 1027.410447] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGH for action security_group_rules [ 1027.410573] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGH for action security_group_rules [ 1027.410573] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGH for action security_group_rules [ 1027.410663] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGH for action security_group_rules [ 1027.410690] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGH for action security_group_rules [ 1027.410732] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGH for action security_group_rules [ 1027.410792] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGH for action security_group_rules [ 1027.410885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.462938] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1027.463203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.463395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.463613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.463805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.463919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.463985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.464156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.464237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.464322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.464411] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.731127] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.731435] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.731574] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.731858] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.732022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.732250] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port bb953f2f-203c-4718-9352-725e66364027 not found, creating... [ 1027.732661] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.732879] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.733083] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.733394] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.733565] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.733883] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.734171] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.734916] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.734916] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.734916] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.734916] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: bb953f2f-203c-4718-9352-725e66364027 is going to be created. [ 1027.753582] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.753996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.753996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.754210] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.754501] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.754714] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.894244] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 1027.913023] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.913253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.913331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.913542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.934162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.934420] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.934565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.934659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.934982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.935120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.935413] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.935552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.935645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.935851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.936426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.936426] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.936426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.936426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.936655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.936687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.936810] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1027.968948] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.969147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.969204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.969373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.969537] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.969637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.969698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.969848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.969929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.970023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.970172] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.970262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.970319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.970467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.970623] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.970719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.970781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.970915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.970988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.971085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.971190] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.000448] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.000588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.000659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.000870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.001021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.011942] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1028.473458] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25c2ea4d-ec48-482b-ad32-9b9a12f4793a: rpc.has_security_group_logging(os_id): False [ 1028.490135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.490293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.490340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.490555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.490647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.490858] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.490949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.491022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.491192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.491363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.491485] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.491577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.491638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.491780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.491851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.492035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.492128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.492187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.492319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.492392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.492486] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be created. [ 1028.525625] env[68828]: INFO networking_nsxv3.common.synchronization [req-af7f0149-2b3e-474b-a1fc-526579231824 req-67c2b2ee-682a-46b7-8b80-8b4b065e0eb4 service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1028.525829] env[68828]: INFO networking_nsxv3.common.synchronization [req-af7f0149-2b3e-474b-a1fc-526579231824 req-67c2b2ee-682a-46b7-8b80-8b4b065e0eb4 service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1028.525989] env[68828]: INFO networking_nsxv3.common.synchronization [req-af7f0149-2b3e-474b-a1fc-526579231824 req-67c2b2ee-682a-46b7-8b80-8b4b065e0eb4 service nova] Enqueued Resource ID: bb953f2f-203c-4718-9352-725e66364027 with Priority: HIGHEST for action port [ 1028.526419] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1028.526490] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1028.526644] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb953f2f-203c-4718-9352-725e66364027 with Priority: HIGHEST for action port [ 1028.526687] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 with Priority: HIGH for action security_group_rules [ 1028.526764] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 with Priority: HIGH for action security_group_rules [ 1028.526859] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad64928-35ab-4360-b3b2-a74c9841860d with Priority: HIGH for action security_group_rules [ 1028.526951] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 with Priority: HIGH for action security_group_rules [ 1028.527159] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08e462e-e8d3-4628-bfb2-6725e011db83 with Priority: HIGH for action security_group_rules [ 1028.527279] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9cd372-4403-4f1e-910f-c55839944672 with Priority: HIGH for action security_group_rules [ 1028.527374] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 with Priority: HIGH for action security_group_rules [ 1028.527487] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGH for action security_group_rules [ 1028.527773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 with Priority: HIGH for action security_group_rules [ 1028.527773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 with Priority: HIGH for action security_group_rules [ 1028.527773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 with Priority: HIGH for action security_group_rules [ 1028.527928] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec with Priority: HIGH for action security_group_rules [ 1028.527928] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123868e6-4541-435b-9bd1-c8af4f43c09a with Priority: HIGH for action security_group_rules [ 1028.528055] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 with Priority: HIGH for action security_group_rules [ 1028.528088] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d51724-5116-4cde-bbe3-36293e35d81b with Priority: HIGH for action security_group_rules [ 1028.528162] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ac7969-2394-41c5-ac03-dedae73eb17f with Priority: HIGH for action security_group_rules [ 1028.528235] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGH for action security_group_rules [ 1028.528338] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc128506-c5e7-4179-a805-6679a20e9957 with Priority: HIGH for action security_group_rules [ 1028.528420] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f82e204-74c2-4f16-ab6e-65554153de56 with Priority: HIGH for action security_group_rules [ 1028.528500] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGH for action security_group_rules [ 1028.529475] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.529608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.529675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.529878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.529960] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.530826] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.530943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.531077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.531309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.531457] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.531557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.531614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.531756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.531833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.531995] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.533283] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb953f2f-203c-4718-9352-725e66364027 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.533396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.533461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.533613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.533689] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb953f2f-203c-4718-9352-725e66364027',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.534485] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e73ec652-3cf2-4f74-85a7-b281cb693a56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.534663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.534744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.534898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.534975] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e73ec652-3cf2-4f74-85a7-b281cb693a56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.536068] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.536237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.536330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.536553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.536654] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f83419-8dd4-4326-ad0d-7a38e73a74f4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.537584] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ad64928-35ab-4360-b3b2-a74c9841860d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.537736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.537812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.538092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.538092] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ad64928-35ab-4360-b3b2-a74c9841860d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.538858] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.538967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.539060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.539243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.539350] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('826410a3-2e17-4f39-bb2e-9ab8ef871c84',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.540109] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d08e462e-e8d3-4628-bfb2-6725e011db83 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.540227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.540275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.540423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.540507] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d08e462e-e8d3-4628-bfb2-6725e011db83',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.541284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9cd372-4403-4f1e-910f-c55839944672 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.541397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.541471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.541607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.541679] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9cd372-4403-4f1e-910f-c55839944672',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.542748] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72dfb289-4716-4f30-92e1-ad6fe6010326 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.542748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.542748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.542947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.543059] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72dfb289-4716-4f30-92e1-ad6fe6010326',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.543940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.544029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.544088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.544249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.544320] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.545192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.545192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.545303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.545403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.545475] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8e993f1-ee06-4325-98b9-4dc8467a2fb3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.546278] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0772c5f0-7902-49dd-8073-f3ce338b4a68 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.546278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.546354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.546491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.546558] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0772c5f0-7902-49dd-8073-f3ce338b4a68',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.547284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.547439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.547514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.547661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.547736] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.548390] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.548492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.548563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.548713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.548840] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.551262] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-123868e6-4541-435b-9bd1-c8af4f43c09a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.551375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.551447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.551612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.551686] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('123868e6-4541-435b-9bd1-c8af4f43c09a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.552378] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.552480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.552527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.552693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.552768] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3520fd5-ed17-4f2b-837a-d2cb4c3d0573',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.553594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d51724-5116-4cde-bbe3-36293e35d81b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.553815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.553921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.554168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.554292] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d51724-5116-4cde-bbe3-36293e35d81b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.555248] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42ac7969-2394-41c5-ac03-dedae73eb17f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.555248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.555351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.555468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.555542] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42ac7969-2394-41c5-ac03-dedae73eb17f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.556314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.556471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.556471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.556619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.556693] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.557610] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc128506-c5e7-4179-a805-6679a20e9957 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.557721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.557790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.557949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.558011] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc128506-c5e7-4179-a805-6679a20e9957',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.558684] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f82e204-74c2-4f16-ab6e-65554153de56 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.558794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.558870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.559131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.559131] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f82e204-74c2-4f16-ab6e-65554153de56',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.560227] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.560354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.560423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.560575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.560651] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.565163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.565239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.565268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.565426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.565604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.578929] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1029.064898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.065063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.065135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.065353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.065672] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.065672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.065781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.065864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.065941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.066064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.066174] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.069125] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.069258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.077777] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb953f2f-203c-4718-9352-725e66364027 with status ACTIVE [ 1029.077777] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.077777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.077777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.077777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.077777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.078022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.078833] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.078833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.079107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.079107] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb953f2f-203c-4718-9352-725e66364027 is going to be updated. [ 1029.085576] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.090371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.090496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.090578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.090755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.090909] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.091016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.091216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.091216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.091314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.091369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.091456] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.094032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.094152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.094234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.094634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.094634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.094634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.094806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.094836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.094910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.095012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.095101] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.110974] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.116386] env[68828]: INFO networking_nsxv3.common.synchronization [req-6b5b1e78-cab6-4c05-b818-3e05510f472f req-dccfad35-ccc6-45ba-89ce-a7bfb98a2eb4 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_members [ 1029.133275] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_members [ 1029.138699] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.138699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.138699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.138699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.144340] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.144440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.147453] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.147567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.148506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.148506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.148506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.148506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.148506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.148506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.148506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.148506] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.150446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.150446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.151172] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.151269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.151998] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.152091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.155396] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.155396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.155638] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.155638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.156653] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.156743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.157758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.158326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.159552] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.159650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.160373] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.160480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.161092] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.161511] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.161619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.162352] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.162723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.162816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.163912] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.164299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.164388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.165208] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.165655] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.165746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.170753] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.171263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.171378] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 826410a3-2e17-4f39-bb2e-9ab8ef871c84 is going to be deleted. [ 1029.172490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.172696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.174477] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.174564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.175298] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.175400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.176598] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.177015] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.177132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.177233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.177405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.177544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.177699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb953f2f-203c-4718-9352-725e66364027" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.192438] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.192936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.193072] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d08e462e-e8d3-4628-bfb2-6725e011db83 is going to be deleted. [ 1029.193995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.194242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.211571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.211692] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f82e204-74c2-4f16-ab6e-65554153de56 is going to be deleted. [ 1029.212677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.212920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.230594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.230726] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42ac7969-2394-41c5-ac03-dedae73eb17f is going to be deleted. [ 1029.232072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.232292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.269165] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.269165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.270248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.270376] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e73ec652-3cf2-4f74-85a7-b281cb693a56 is going to be deleted. [ 1029.271800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.271951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.272013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.272175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.272289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.272388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d08e462e-e8d3-4628-bfb2-6725e011db83" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.272570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.272703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.276719] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.277169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.344170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.344304] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72dfb289-4716-4f30-92e1-ad6fe6010326 is going to be deleted. [ 1029.345179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.345406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.346743] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.346850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.394568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.394708] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0772c5f0-7902-49dd-8073-f3ce338b4a68 is going to be deleted. [ 1029.395794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.396466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.432712] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.432856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.437148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.437278] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d51724-5116-4cde-bbe3-36293e35d81b is going to be deleted. [ 1029.438300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.438524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.469787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.469918] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec is going to be deleted. [ 1029.470856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.471127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.472603] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.472718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.475766] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.476040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.523287] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.523512] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.523642] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.523910] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.524205] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.524378] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.524566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.524847] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.525014] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.525359] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.525548] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.525609] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.525718] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.525836] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.525942] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.526096] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.528379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.528486] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8e993f1-ee06-4325-98b9-4dc8467a2fb3 is going to be deleted. [ 1029.529263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.529428] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.561044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.561214] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03 is going to be deleted. [ 1029.562365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.562622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.568249] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.568380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.568452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.568630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.568799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.568908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.568973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.569131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.569222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.569310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.569454] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.569545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.569607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.569747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.569878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.569970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.570041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.570178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.570251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.570330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.570413] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.587858] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.593438] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.593601] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.067 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.593745] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.593924] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.594244] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.594426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.594548] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.594878] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.595060] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b5050d1-a5b9-43d7-a33f-aadd2e40d71f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.605196] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.605327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.605388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.605575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.605720] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.605813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.605874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.606025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.606109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.606193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.606332] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.606419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.606476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.606609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.606740] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.606827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.606887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.607028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.607104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.607182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.607264] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.612277] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d03381a0-8611-467b-849f-03e37e47978c: rpc.has_security_group_logging(os_id): False [ 1029.614080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.614198] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3520fd5-ed17-4f2b-837a-d2cb4c3d0573 is going to be deleted. [ 1029.614998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.615188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.621644] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.621756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.638912] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.639033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.650848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.650974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.675035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.675147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.793471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.793603] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc128506-c5e7-4179-a805-6679a20e9957 is going to be deleted. [ 1029.794667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.794778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.846185] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.846365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.855829] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.855987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.894291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.894467] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f83419-8dd4-4326-ad0d-7a38e73a74f4 is going to be deleted. [ 1029.895379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.895675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.948389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.948660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.971889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.972112] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9cd372-4403-4f1e-910f-c55839944672 is going to be deleted. [ 1029.973327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.973575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.014786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.014928] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 123868e6-4541-435b-9bd1-c8af4f43c09a is going to be deleted. [ 1030.015949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.016194] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.016369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.016411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-826410a3-2e17-4f39-bb2e-9ab8ef871c84" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.017054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.017241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.027043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.027449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.045262] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.045454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.072600] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fdb4832-fb6b-46dc-9929-5e545ccfc219: rpc.has_security_group_logging(os_id): False [ 1030.075019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1030.075416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.076542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.076704] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ad64928-35ab-4360-b3b2-a74c9841860d is going to be deleted. [ 1030.077796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.078119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.078340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.078340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f82e204-74c2-4f16-ab6e-65554153de56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.079785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.079785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.079785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.079785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42ac7969-2394-41c5-ac03-dedae73eb17f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.079978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.080120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.080282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.080448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e73ec652-3cf2-4f74-85a7-b281cb693a56" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.080617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.080827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.080916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.081057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0772c5f0-7902-49dd-8073-f3ce338b4a68" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.081280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.081459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.081581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.081656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72dfb289-4716-4f30-92e1-ad6fe6010326" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.081838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.082115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.082254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.082419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d51724-5116-4cde-bbe3-36293e35d81b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.082611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.082812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.082896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.083068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d29a62b-d9ce-4760-b2b9-ed2d515ba5ec" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.083771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.083771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.083771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.083947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.084035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.084083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.084305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.084421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.084552] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a already deleted. [ 1030.084552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.084715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.084859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.089711] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.089891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.090025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.090225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.090311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.090407] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be created. [ 1030.097590] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.097780] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.097915] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.098256] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.098948] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.098948] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 6b5050d1-a5b9-43d7-a33f-aadd2e40d71f not found, creating... [ 1030.098948] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.099136] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.099166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.099411] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.099681] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.100059] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.100234] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.100453] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.100760] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.101042] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.101165] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 6b5050d1-a5b9-43d7-a33f-aadd2e40d71f is going to be created. [ 1030.105622] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.105740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.109084] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 061e7957-d08e-4436-88e2-d8f6b78364a8: rpc.has_security_group_logging(os_id): False [ 1030.141608] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.141799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.141887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.142063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.142231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.147765] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.147918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.149785] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.149982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.163405] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: UNINITIALIZED for 2s [ 1030.169614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.169939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.170059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.170133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.170353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.170429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.170527] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d03381a0-8611-467b-849f-03e37e47978c is going to be updated. [ 1030.171673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.171856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.171901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.172032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8e993f1-ee06-4325-98b9-4dc8467a2fb3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.172295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.172452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.172533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.172656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e8b4d0-5c3c-49d7-818c-d81ddf51bc03" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.173215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.173354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.173432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.173555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3520fd5-ed17-4f2b-837a-d2cb4c3d0573" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.173673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.173816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.173894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.174009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f83419-8dd4-4326-ad0d-7a38e73a74f4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.175555] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.175685] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.175814] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.176463] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.176463] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.176617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.177767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.178048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc128506-c5e7-4179-a805-6679a20e9957" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.178608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.178690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9cd372-4403-4f1e-910f-c55839944672" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.179103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.203897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.204110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.224370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.224557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.281417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.281906] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.282093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.282093] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.282318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.282391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.282606] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.282695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.282753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.282905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.282979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.283220] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.283337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.283373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.283504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.283573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.283667] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be updated. [ 1030.284776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.284940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.329639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.329639] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.329639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.329639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.329639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.329639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.329639] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.329952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.329952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.329952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.330038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.330295] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.330404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.330473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.330615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.330689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.330781] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 1030.331979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.332157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.332264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.332444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-123868e6-4541-435b-9bd1-c8af4f43c09a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.332647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.332808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.332893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.333013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ad64928-35ab-4360-b3b2-a74c9841860d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.368189] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.368431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.368431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.368560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.368728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.404143] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: IN_PROGRESS for 2s [ 1030.463252] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.463252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.463445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.463527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.463677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.465966] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.466101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.466153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.466335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.466467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.485710] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 1030.486521] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.486973] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 1030.590353] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1030.590603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.875650] env[68828]: INFO networking_nsxv3.common.synchronization [req-6b5b1e78-cab6-4c05-b818-3e05510f472f req-d84d11ba-7fed-4cc5-880a-758304913434 service nova] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_rules [ 1030.875945] env[68828]: INFO networking_nsxv3.common.synchronization [req-6b5b1e78-cab6-4c05-b818-3e05510f472f req-d84d11ba-7fed-4cc5-880a-758304913434 service nova] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_members [ 1030.876219] env[68828]: INFO networking_nsxv3.common.synchronization [req-6b5b1e78-cab6-4c05-b818-3e05510f472f req-d84d11ba-7fed-4cc5-880a-758304913434 service nova] Enqueued Resource ID: 6b5050d1-a5b9-43d7-a33f-aadd2e40d71f with Priority: HIGHEST for action port [ 1030.876966] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_rules [ 1030.877631] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_members [ 1030.877828] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5050d1-a5b9-43d7-a33f-aadd2e40d71f with Priority: HIGHEST for action port [ 1030.878248] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.878486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.878608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.878902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.879075] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.883944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.883944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.883944] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.883944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.883944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.885028] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b5050d1-a5b9-43d7-a33f-aadd2e40d71f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.390022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.390022] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.390022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b5050d1-a5b9-43d7-a33f-aadd2e40d71f with status ACTIVE [ 1031.390022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.390022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.390022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.391601] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.391866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.392043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.392296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.392637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.392812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b5050d1-a5b9-43d7-a33f-aadd2e40d71f is going to be updated. [ 1031.414937] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.414937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.414937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.414937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.414937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.414937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b5050d1-a5b9-43d7-a33f-aadd2e40d71f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.895011] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.175481] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.177133] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.177133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.177133] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.397862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.397862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.397862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.398177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.398177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.398177] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a is going to be created. [ 1032.416018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: SUCCESS [ 1032.416255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.423368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.423481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.423632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.423945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.424203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.432392] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e89052b-2796-4bf5-84ca-4753e088c73a in Status: UNINITIALIZED for 2s [ 1032.508187] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 1032.508434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.509217] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 1032.509395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.681040] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.184652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27a4adfb-8bb8-4644-a926-1d5f3c8693cd: rpc.has_security_group_logging(os_id): False [ 1033.209542] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.209701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.209775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.210025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.210123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.210402] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.210483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.210540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.210686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.210766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.210855] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be created. [ 1033.265994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.266160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.266242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.266579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.266826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.276791] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1034.441926] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e89052b-2796-4bf5-84ca-4753e088c73a in Status: SUCCESS [ 1034.442255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.442371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.442696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.442913] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.443101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.443144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.443344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.443970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.443970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.443970] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.947269] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.289046] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1035.289294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.459214] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e89052b-2796-4bf5-84ca-4753e088c73a: rpc.has_security_group_logging(os_id): False [ 1035.476857] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.477050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.477114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.477330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.477415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.477989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.477989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.477989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.478221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.478369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.478495] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a is going to be created. [ 1035.537853] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.538048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.538139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.538356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.538632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.548888] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e89052b-2796-4bf5-84ca-4753e088c73a in Status: IN_PROGRESS for 2s [ 1035.878921] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1035.879083] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1036.282663] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd5c45ae-01e5-4d55-83a3-e679106defac req-299f75ca-ba2d-411b-96a0-778a463c7bd0 tempest-ListImageFiltersTestJSON-1716956093 tempest-ListImageFiltersTestJSON-1716956093-project-member] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 1036.283078] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGHEST for action security_group_members [ 1036.283439] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.283567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.283635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.283834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.283987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.284096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.284155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.284304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.284402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.284503] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.786359] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.786738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.786738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.786978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.787106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.787330] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.787456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.787515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.787754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.787754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.787856] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be updated. [ 1036.813942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.814120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.814214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.814447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.814592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.834900] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: IN_PROGRESS for 2s [ 1037.518233] env[68828]: INFO networking_nsxv3.common.synchronization [req-add20450-3b1a-4fde-b2bf-006c9ac45646 req-7f7dd36a-1634-4adf-bab3-a586e66d10ac tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1037.518233] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1037.518233] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.522021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.522021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.522021] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.560320] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e89052b-2796-4bf5-84ca-4753e088c73a in Status: SUCCESS [ 1037.560756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.024680] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.024954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.024954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.025162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.025162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.025319] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.025433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.025498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.025658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.025706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.026303] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1038.051778] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.051919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.051991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.052219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.052359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.062534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1038.846073] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 in Status: SUCCESS [ 1038.846279] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 deletion is rescheduled due to dependency. [ 1038.846400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.908908] env[68828]: INFO networking_nsxv3.common.synchronization [req-b2be2be7-0b98-463e-98ed-85109f515cdb req-ed73354d-70eb-40e9-b644-594db5a17f10 tempest-ServersTestJSON-438167534 tempest-ServersTestJSON-438167534-project-member] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_members [ 1038.909539] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGHEST for action security_group_members [ 1038.909894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.910249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.910353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.915231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.915231] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.915231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.915231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.915231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.915231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.915231] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.417350] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.417773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.417773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.417895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.440881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.440881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.441244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.441244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.441244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.441596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.441647] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffdab8-bf16-471f-9412-c5026034844d is going to be updated. [ 1039.468033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.468224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.468266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.468623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.468790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.481881] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffdab8-bf16-471f-9412-c5026034844d in Status: IN_PROGRESS for 2s [ 1040.075279] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1040.078184] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1040.078184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.471318] env[68828]: INFO networking_nsxv3.common.synchronization [req-31053687-2d3c-412f-9253-9560af721dc7 req-0a46e9b4-a16b-4091-902f-8df10ba0dce7 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_members [ 1040.478410] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGHEST for action security_group_members [ 1040.479682] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.479880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.479974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.480329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.480575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.480729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.480827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.482770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.482952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.483113] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.985643] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.985925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.986073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.986501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.013305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.013550] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.013685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.013745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.013949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.014052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.015357] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 is going to be updated. [ 1041.046152] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.046916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.047131] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.047549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.047818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.057111] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 in Status: IN_PROGRESS for 2s [ 1041.492710] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffdab8-bf16-471f-9412-c5026034844d in Status: SUCCESS [ 1041.492959] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffdab8-bf16-471f-9412-c5026034844d deletion is rescheduled due to dependency. [ 1041.493117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.793204] env[68828]: INFO networking_nsxv3.common.synchronization [req-dcdc43fa-327a-4599-9d4d-7f7f51e8c285 req-4f8b59a1-8cc9-47b2-ae4f-13aaece24ac9 tempest-ServerRescueNegativeTestJSON-1083036709 tempest-ServerRescueNegativeTestJSON-1083036709-project-member] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 1041.794426] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGHEST for action security_group_members [ 1041.794426] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.794426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.794426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.794703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.794736] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.794834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.794894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.795239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.795335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.795435] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.298141] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.298421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.298497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.298689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.320429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.320750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.320898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.320984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.321243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.321495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.321495] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be updated. [ 1042.343913] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.343913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.344064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.344168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.344304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.352323] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: IN_PROGRESS for 2s [ 1042.472469] env[68828]: INFO networking_nsxv3.common.synchronization [req-289164ac-cb45-4e94-ba61-5f2a4ba7d3c3 req-9887d16e-d1f4-483f-8036-7348eac09a3f tempest-ImagesTestJSON-1043513357 tempest-ImagesTestJSON-1043513357-project-member] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 1042.472999] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGHEST for action security_group_members [ 1042.473319] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.473484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.473586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.473772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.473925] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.474115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.474166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.474337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.474426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.474517] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.976327] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.976656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.976656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.976789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.976863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.977073] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.977173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.977240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.977387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.977465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.977553] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be updated. [ 1043.003873] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.004027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.004101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.004312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.004454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.012240] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: IN_PROGRESS for 2s [ 1043.069702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 in Status: SUCCESS [ 1043.069906] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 deletion is rescheduled due to dependency. [ 1043.070137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.007011] env[68828]: INFO networking_nsxv3.common.synchronization [req-1dc6d53f-62a3-459c-a92c-be62c404b8ad req-ea41dda3-1106-4199-9c49-fa812c6acc84 tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1044.007590] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1044.007866] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.007985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.008165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.008639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.008709] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.008781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.008827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.009117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.009117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.009206] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.313258] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.313506] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.313664] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.313942] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.314216] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.314407] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.314538] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.314762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.314970] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.315222] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.315266] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.315382] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.315494] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.315623] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.315714] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.315876] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.338131] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.338324] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.338479] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.338660] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.338969] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.339164] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.339817] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.339817] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.339817] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2af6227-819c-4e56-8ce0-ed37e79d6bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.361675] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 in Status: SUCCESS [ 1044.361984] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 deletion is rescheduled due to dependency. [ 1044.361984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.511481] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.847412] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.847412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.847412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.847412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.847412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.847412] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port e2af6227-819c-4e56-8ce0-ed37e79d6bf3 not found, creating... [ 1044.847412] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.848308] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.848759] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.849546] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.851832] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.851832] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.851832] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.851832] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.854623] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.854623] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.854623] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: e2af6227-819c-4e56-8ce0-ed37e79d6bf3 is going to be created. [ 1044.875858] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.877358] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.877358] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.880066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.880066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.880066] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.988563] env[68828]: INFO networking_nsxv3.common.synchronization [None req-3d118e6f-8084-41f6-bbd0-9c5a124e6622 None None] Enqueued Resource ID: 5e7c3a02-77a4-4b60-9a93-abdcd4dc612e with Priority: HIGHEST for action port [ 1044.988563] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7c3a02-77a4-4b60-9a93-abdcd4dc612e with Priority: HIGHEST for action port [ 1044.988563] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e7c3a02-77a4-4b60-9a93-abdcd4dc612e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.989500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e7c3a02-77a4-4b60-9a93-abdcd4dc612e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.989722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e7c3a02-77a4-4b60-9a93-abdcd4dc612e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.990341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e7c3a02-77a4-4b60-9a93-abdcd4dc612e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.990644] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e7c3a02-77a4-4b60-9a93-abdcd4dc612e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.015326] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.023205] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 in Status: SUCCESS [ 1045.023205] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 deletion is rescheduled due to dependency. [ 1045.023205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.494734] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e7c3a02-77a4-4b60-9a93-abdcd4dc612e [ 1045.494996] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.495160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.495244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.495476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.495599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.495667] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e7c3a02-77a4-4b60-9a93-abdcd4dc612e already deleted. [ 1045.495770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e7c3a02-77a4-4b60-9a93-abdcd4dc612e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.519865] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.519865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.519865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.519865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.520316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.520316] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1045.550593] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.550593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.550781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.550980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.551065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.561592] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1045.654346] env[68828]: INFO networking_nsxv3.common.synchronization [req-1dc6d53f-62a3-459c-a92c-be62c404b8ad req-b247614a-5135-4f39-ae09-c7c9e8c69fa4 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1045.654346] env[68828]: INFO networking_nsxv3.common.synchronization [req-1dc6d53f-62a3-459c-a92c-be62c404b8ad req-b247614a-5135-4f39-ae09-c7c9e8c69fa4 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1045.654499] env[68828]: INFO networking_nsxv3.common.synchronization [req-1dc6d53f-62a3-459c-a92c-be62c404b8ad req-b247614a-5135-4f39-ae09-c7c9e8c69fa4 service nova] Enqueued Resource ID: e2af6227-819c-4e56-8ce0-ed37e79d6bf3 with Priority: HIGHEST for action port [ 1045.655039] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1045.655180] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1045.655283] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2af6227-819c-4e56-8ce0-ed37e79d6bf3 with Priority: HIGHEST for action port [ 1045.656031] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.656031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.656415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.656634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.656720] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.657848] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.657977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.658178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.658283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.658340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.658511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.658622] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2af6227-819c-4e56-8ce0-ed37e79d6bf3',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.800423] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d80259b3-28c6-4ac5-829d-30b21c481f9e tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1045.801776] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1045.805164] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.805164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.805164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.805164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.805164] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.904427] env[68828]: INFO networking_nsxv3.common.synchronization [None req-8ea27dbb-0067-48e5-906a-8c2db7826dd0 tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1045.904995] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1045.905627] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.905865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.160634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.160985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.160985] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2af6227-819c-4e56-8ce0-ed37e79d6bf3 with status ACTIVE [ 1046.161211] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.161293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.161351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.161545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.161628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.161796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.162424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.162424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.162424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.162424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.162424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.162424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.162719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.162719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.162719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.162793] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2af6227-819c-4e56-8ce0-ed37e79d6bf3 is going to be updated. [ 1046.203371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.203371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.203371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.203371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.203371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.203371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2af6227-819c-4e56-8ce0-ed37e79d6bf3" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.328744] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.328901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.328965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.329599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.329686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.329756] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea already deleted. [ 1046.330396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.330396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.330396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.330396] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.854934] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.855642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.855753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.858684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.858684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.858684] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea already deleted. [ 1046.858684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.454990] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c53febdb-01ec-4fbc-bf33-862995ac5692 None None] Enqueued Resource ID: 6ae965a8-d47b-41f6-8685-2db1161a7640 with Priority: HIGHEST for action port [ 1047.454990] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae965a8-d47b-41f6-8685-2db1161a7640 with Priority: HIGHEST for action port [ 1047.455300] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae965a8-d47b-41f6-8685-2db1161a7640 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.455300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae965a8-d47b-41f6-8685-2db1161a7640" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.455300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae965a8-d47b-41f6-8685-2db1161a7640" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.455457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae965a8-d47b-41f6-8685-2db1161a7640" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.455537] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae965a8-d47b-41f6-8685-2db1161a7640',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.573096] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1047.577039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.577186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.577453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.577695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.577851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.577933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.578161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.578305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.578366] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.959488] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ae965a8-d47b-41f6-8685-2db1161a7640 [ 1047.959581] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.959714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.959779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.959980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.960090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.960186] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ae965a8-d47b-41f6-8685-2db1161a7640 already deleted. [ 1047.960260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae965a8-d47b-41f6-8685-2db1161a7640" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.081123] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.582917] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.086138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.086378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.086378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.086594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.086714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.086789] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1049.119060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.119229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.119289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.119481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.119624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.127886] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1051.153073] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.153073] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.153073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.153073] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.655679] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.655952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.655952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.656236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.656372] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.656492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.656581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.656700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.656787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.656883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.657042] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.657152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.657222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.657331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.657464] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.657554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.657622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.657736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.657805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.657873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.657963] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.080258] env[68828]: INFO networking_nsxv3.common.synchronization [req-ef1e5d20-f4da-41ef-9aec-904df0a39444 req-e4bf1546-3866-40bd-b8fd-94eec5bdc49f tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1052.081081] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1052.081675] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.082114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.082281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.082674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.082913] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.083144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.083287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.083530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.083903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.085091] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.161691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 1052.177506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.178045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.178207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.178569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.178676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.178930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.179009] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.179136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.179642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.179758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.180017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.180130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.180196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.180341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.180420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.182367] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.182367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.182367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.182367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.182367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.182367] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1052.241993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.242284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.242372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.242596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.242787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.254411] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1052.588620] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.588620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.588620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.588620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.608562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.608881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.609026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.609026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.609232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.609312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.609394] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 1052.637920] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.638141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.641038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.641038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.641038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.648218] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 1054.267100] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1054.267384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.657716] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 1054.657943] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 1054.658079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.604699] env[68828]: INFO networking_nsxv3.common.synchronization [None req-453633bc-c480-4c25-9b0f-47c8e64e2628 None None] Enqueued Resource ID: 86a5c45e-7650-48c5-b142-1d22999eef3f with Priority: HIGHEST for action port [ 1056.604948] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a5c45e-7650-48c5-b142-1d22999eef3f with Priority: HIGHEST for action port [ 1056.605563] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a5c45e-7650-48c5-b142-1d22999eef3f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.605706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a5c45e-7650-48c5-b142-1d22999eef3f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.605775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a5c45e-7650-48c5-b142-1d22999eef3f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.606286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a5c45e-7650-48c5-b142-1d22999eef3f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.606403] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a5c45e-7650-48c5-b142-1d22999eef3f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.108745] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86a5c45e-7650-48c5-b142-1d22999eef3f [ 1057.109036] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.109161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.109201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.109396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.109484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.109581] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86a5c45e-7650-48c5-b142-1d22999eef3f already deleted. [ 1057.109858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a5c45e-7650-48c5-b142-1d22999eef3f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.468042] env[68828]: INFO networking_nsxv3.common.synchronization [None req-29556a73-e70a-4e88-8f7d-5c49f711e2fe tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1057.468458] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1057.469055] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.469055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.469055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.469528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.469593] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.555291] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7da5bbe6-a607-465d-adb0-2bf6c6723684 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1057.555769] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1057.556138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.556238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.991594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.991894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.991894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.992037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.992596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.992596] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 already deleted. [ 1057.992596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.992596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.992596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.992794] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.501817] env[68828]: INFO networking_nsxv3.common.synchronization [req-19aa0167-596f-431e-b573-cf4dfe51d19f req-f826d713-0a4d-49be-8196-4823080a92ce tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1058.502773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1058.502871] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.503128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.503128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.503264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.503412] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.503511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.503573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.503733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.503824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.503916] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.511668] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.511796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.512266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.512266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.512266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.512266] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 already deleted. [ 1058.512436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.007183] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.167869] env[68828]: INFO networking_nsxv3.common.synchronization [None req-bccbec88-79c9-4021-98d6-9080fb2b6fb8 None None] Enqueued Resource ID: ad44b3b9-17db-418c-8171-d11e6f4d9e0f with Priority: HIGHEST for action port [ 1059.168139] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad44b3b9-17db-418c-8171-d11e6f4d9e0f with Priority: HIGHEST for action port [ 1059.168726] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad44b3b9-17db-418c-8171-d11e6f4d9e0f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.168846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad44b3b9-17db-418c-8171-d11e6f4d9e0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.168912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad44b3b9-17db-418c-8171-d11e6f4d9e0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.169213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad44b3b9-17db-418c-8171-d11e6f4d9e0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.169293] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad44b3b9-17db-418c-8171-d11e6f4d9e0f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.510352] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.676340] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad44b3b9-17db-418c-8171-d11e6f4d9e0f [ 1059.676340] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.676340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.676340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.676340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.676340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.676340] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad44b3b9-17db-418c-8171-d11e6f4d9e0f already deleted. [ 1059.676340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad44b3b9-17db-418c-8171-d11e6f4d9e0f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.018283] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.018283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.018283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.018283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.018283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.018283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1060.044182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.044182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.044182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.044182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.044182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.051382] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1061.045637] env[68828]: INFO networking_nsxv3.common.synchronization [req-327681b0-56a4-4b46-8f9f-915e27ba31ee req-fefc59cd-712f-4cd1-ace7-abdf1bdd7011 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_members [ 1061.046162] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGHEST for action security_group_members [ 1061.046445] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.046558] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.046628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.048551] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.048968] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.049138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.049258] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.049545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.049687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.049826] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.387271] env[68828]: INFO networking_nsxv3.common.synchronization [req-42e126e3-b682-45e3-97eb-4c6f163970d2 req-5ca442ed-f8a2-4ea4-8e7d-ecfed00178c3 tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1061.387816] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1061.388156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.388284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.389207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.389506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.389711] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.389853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.389947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.390147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.390269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.390390] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.538848] env[68828]: INFO networking_nsxv3.common.synchronization [None req-be576d55-2bd9-4ceb-bc6f-36678e854dc2 None None] Enqueued Resource ID: ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b with Priority: HIGHEST for action port [ 1061.539119] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b with Priority: HIGHEST for action port [ 1061.539652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.539804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.539858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.542186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.542311] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.554047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.554180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.554253] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.554452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.554541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.554763] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.554923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.555032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.555197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.555279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.555371] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d03381a0-8611-467b-849f-03e37e47978c is going to be updated. [ 1061.579914] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.580066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.580141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.580327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.580477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.588122] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: IN_PROGRESS for 2s [ 1061.892745] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.893160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.893249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.893469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.893563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.893809] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.895393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.895846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.896334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.896444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.896568] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea already deleted. [ 1061.896682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.045219] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b [ 1062.045477] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.045642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.045731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.045986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.046124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.046239] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b already deleted. [ 1062.046345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac12aa49-cb6a-464b-ae98-ca8fcc0f7c4b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.059656] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1062.059856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.169338] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.169605] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.169766] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.170178] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.170722] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.170722] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.170722] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.170948] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.173438] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.173796] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.173870] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.173996] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.174140] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.174462] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.174462] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.174528] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.192889] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.193129] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1062.193304] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.193514] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.194065] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-f95ade32-ced6-4c6f-a502-11af5518764f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.194260] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.194517] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.194746] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.194863] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95ade32-ced6-4c6f-a502-11af5518764f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.698117] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.698385] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.698657] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.698822] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.699022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.699203] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port f95ade32-ced6-4c6f-a502-11af5518764f not found, creating... [ 1062.699482] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.700712] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.700712] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.700712] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.700712] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.700712] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.704166] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.704356] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.704628] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.704795] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.705054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: f95ade32-ced6-4c6f-a502-11af5518764f is going to be created. [ 1062.724448] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.724658] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.724801] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.725067] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.725300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.725527] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.865450] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6f52fcb5-c6c8-4301-a498-70776bd8ba2f None None] Enqueued Resource ID: ebb36318-714b-46f6-9236-8cdbb8e3c065 with Priority: HIGHEST for action port [ 1062.865747] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb36318-714b-46f6-9236-8cdbb8e3c065 with Priority: HIGHEST for action port [ 1062.866400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebb36318-714b-46f6-9236-8cdbb8e3c065 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.866458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebb36318-714b-46f6-9236-8cdbb8e3c065" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.866543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebb36318-714b-46f6-9236-8cdbb8e3c065" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.866725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebb36318-714b-46f6-9236-8cdbb8e3c065" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.866805] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebb36318-714b-46f6-9236-8cdbb8e3c065',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.371126] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebb36318-714b-46f6-9236-8cdbb8e3c065 [ 1063.371126] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.371126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.371126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.371126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.371126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.371720] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebb36318-714b-46f6-9236-8cdbb8e3c065 already deleted. [ 1063.371720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebb36318-714b-46f6-9236-8cdbb8e3c065" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.596954] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d03381a0-8611-467b-849f-03e37e47978c in Status: SUCCESS [ 1063.597171] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d03381a0-8611-467b-849f-03e37e47978c deletion is rescheduled due to dependency. [ 1063.597287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.754466] env[68828]: INFO networking_nsxv3.common.synchronization [None req-9fa617ad-69b1-47dd-920e-60d3a90fe94d None None] Enqueued Resource ID: d5a9f036-8e24-4951-9b7a-392a98033677 with Priority: HIGHEST for action port [ 1063.754774] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a9f036-8e24-4951-9b7a-392a98033677 with Priority: HIGHEST for action port [ 1063.755179] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5a9f036-8e24-4951-9b7a-392a98033677 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.755311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5a9f036-8e24-4951-9b7a-392a98033677" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.755382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5a9f036-8e24-4951-9b7a-392a98033677" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.755628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5a9f036-8e24-4951-9b7a-392a98033677" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.755728] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5a9f036-8e24-4951-9b7a-392a98033677',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.841580] env[68828]: INFO networking_nsxv3.common.synchronization [None req-87a3531b-62a1-4a48-888b-b99ee947b086 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1063.841580] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1063.841580] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.841580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.841580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.844838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.844838] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.930183] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7ac9163a-4c3c-43b2-bcba-843ce671aa37 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1063.930688] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1063.931328] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.931328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.993848] env[68828]: INFO networking_nsxv3.common.synchronization [req-42e126e3-b682-45e3-97eb-4c6f163970d2 req-a9bcec3a-4696-4199-8d42-e32adbe8c396 service nova] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1063.993848] env[68828]: INFO networking_nsxv3.common.synchronization [req-42e126e3-b682-45e3-97eb-4c6f163970d2 req-a9bcec3a-4696-4199-8d42-e32adbe8c396 service nova] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1063.993848] env[68828]: INFO networking_nsxv3.common.synchronization [req-42e126e3-b682-45e3-97eb-4c6f163970d2 req-a9bcec3a-4696-4199-8d42-e32adbe8c396 service nova] Enqueued Resource ID: f95ade32-ced6-4c6f-a502-11af5518764f with Priority: HIGHEST for action port [ 1063.994285] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1063.994402] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1063.994477] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f95ade32-ced6-4c6f-a502-11af5518764f with Priority: HIGHEST for action port [ 1063.995047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.995047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.995047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.995165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.995287] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.996328] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.996328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.996398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.996593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.996704] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.997056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.997056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.997056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.997164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.997195] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.998058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f95ade32-ced6-4c6f-a502-11af5518764f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.998161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.999085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.999085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.999085] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95ade32-ced6-4c6f-a502-11af5518764f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.262018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5a9f036-8e24-4951-9b7a-392a98033677 [ 1064.262018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.262018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.262018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.262018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.262018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.262018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5a9f036-8e24-4951-9b7a-392a98033677 already deleted. [ 1064.262018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5a9f036-8e24-4951-9b7a-392a98033677" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.363556] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.363693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.363766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.364021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.364197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.364197] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 already deleted. [ 1064.364282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.364423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.364564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.364642] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.502256] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.503355] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.503471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.503636] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f95ade32-ced6-4c6f-a502-11af5518764f with status ACTIVE [ 1064.505400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.505400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.505400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.506836] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.506989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.507084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.507322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.507374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.507490] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f95ade32-ced6-4c6f-a502-11af5518764f is going to be updated. [ 1064.527224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.527409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.527481] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.527681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.527814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.527980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.886490] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.886792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.886792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.887030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.887134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.887239] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 already deleted. [ 1064.887324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.009882] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.069549] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b667f7b4-1cc1-4083-8fc5-6972e081f4a3 None None] Enqueued Resource ID: fe49b220-d7f6-476c-9ea6-4981b4e95e47 with Priority: HIGHEST for action port [ 1065.069549] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe49b220-d7f6-476c-9ea6-4981b4e95e47 with Priority: HIGHEST for action port [ 1065.069549] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe49b220-d7f6-476c-9ea6-4981b4e95e47 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.070199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe49b220-d7f6-476c-9ea6-4981b4e95e47" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.070199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe49b220-d7f6-476c-9ea6-4981b4e95e47" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.070477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe49b220-d7f6-476c-9ea6-4981b4e95e47" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.070632] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe49b220-d7f6-476c-9ea6-4981b4e95e47',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.145379] env[68828]: INFO networking_nsxv3.common.synchronization [req-303f579e-ea92-423e-863d-5905745cbd93 req-95754c61-4d1c-4f83-8ccb-fc429698e358 tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1065.145509] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1065.145891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.145970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.145970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.146209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.146370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.146473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.146538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.146686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.146775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.146864] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.195385] env[68828]: INFO networking_nsxv3.common.synchronization [None req-0df5b9bd-d2d4-4bef-9e63-c9c313d468a8 None None] Enqueued Resource ID: 062f9570-9465-4299-99ef-646c6886e89f with Priority: HIGHEST for action port [ 1065.196224] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062f9570-9465-4299-99ef-646c6886e89f with Priority: HIGHEST for action port [ 1065.196924] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-062f9570-9465-4299-99ef-646c6886e89f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.197061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-062f9570-9465-4299-99ef-646c6886e89f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.197128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-062f9570-9465-4299-99ef-646c6886e89f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.197372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-062f9570-9465-4299-99ef-646c6886e89f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.197451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('062f9570-9465-4299-99ef-646c6886e89f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.467460] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.467706] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.467795] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.469542] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.469910] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.470597] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.471532] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.471771] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.472027] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.472368] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.473301] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.473473] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.473600] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.473923] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.473923] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.474083] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.492401] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.492675] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.492830] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.493025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-916" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.493339] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-1fa82604-1009-455c-86ec-d014497c15a6 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.493516] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.493713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.493989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.494153] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa82604-1009-455c-86ec-d014497c15a6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.513044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.513044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.513435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.513435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.513435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.513511] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea is going to be created. [ 1065.543608] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.543759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.543850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.544100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.544268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.555821] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: UNINITIALIZED for 2s [ 1065.573964] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe49b220-d7f6-476c-9ea6-4981b4e95e47 [ 1065.573964] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.573964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.573964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.573964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.574271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.574271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe49b220-d7f6-476c-9ea6-4981b4e95e47 already deleted. [ 1065.574271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe49b220-d7f6-476c-9ea6-4981b4e95e47" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.650819] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.650990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.651147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.651311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.651408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.651609] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.651707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.651766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.651938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.652032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.652214] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 1065.676803] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.677045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.677159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.677395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.677571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.685908] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 1065.699348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 062f9570-9465-4299-99ef-646c6886e89f [ 1065.699571] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.699700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.699769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.699974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.700078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.700386] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:062f9570-9465-4299-99ef-646c6886e89f already deleted. [ 1065.700386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-062f9570-9465-4299-99ef-646c6886e89f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.996536] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.997124] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.997124] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.997276] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.997453] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.997643] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 1fa82604-1009-455c-86ec-d014497c15a6 not found, creating... [ 1065.997945] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.998129] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.998320] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.998514] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.998659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.998977] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.999171] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.999300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.999540] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.999699] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.999852] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 1fa82604-1009-455c-86ec-d014497c15a6 is going to be created. [ 1066.018039] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.018513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.018513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.019149] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.019149] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.019275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.698085] env[68828]: INFO networking_nsxv3.common.synchronization [req-303f579e-ea92-423e-863d-5905745cbd93 req-6e921f8c-b89c-44d0-8bd3-b7a0cde80f22 service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 1066.698085] env[68828]: INFO networking_nsxv3.common.synchronization [req-303f579e-ea92-423e-863d-5905745cbd93 req-6e921f8c-b89c-44d0-8bd3-b7a0cde80f22 service nova] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1066.698085] env[68828]: INFO networking_nsxv3.common.synchronization [req-303f579e-ea92-423e-863d-5905745cbd93 req-6e921f8c-b89c-44d0-8bd3-b7a0cde80f22 service nova] Enqueued Resource ID: 1fa82604-1009-455c-86ec-d014497c15a6 with Priority: HIGHEST for action port [ 1066.698085] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_rules [ 1066.698521] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1066.698521] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fa82604-1009-455c-86ec-d014497c15a6 with Priority: HIGHEST for action port [ 1066.699514] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.699514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.699514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.699709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.699709] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.701234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.701234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.701234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fa82604-1009-455c-86ec-d014497c15a6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.701234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.701234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.701234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.701977] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa82604-1009-455c-86ec-d014497c15a6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.141576] env[68828]: INFO networking_nsxv3.common.synchronization [None req-135c1cec-14a6-4c52-aab7-bbcbab279a44 None None] Enqueued Resource ID: 87f47227-7f82-4c5a-bf8f-4bfcdd98785f with Priority: HIGHEST for action port [ 1067.142039] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87f47227-7f82-4c5a-bf8f-4bfcdd98785f with Priority: HIGHEST for action port [ 1067.142835] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-87f47227-7f82-4c5a-bf8f-4bfcdd98785f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.142835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87f47227-7f82-4c5a-bf8f-4bfcdd98785f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.142835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87f47227-7f82-4c5a-bf8f-4bfcdd98785f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.143064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87f47227-7f82-4c5a-bf8f-4bfcdd98785f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.143064] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87f47227-7f82-4c5a-bf8f-4bfcdd98785f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.203207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.204025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.204025] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fa82604-1009-455c-86ec-d014497c15a6 with status ACTIVE [ 1067.204025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.204025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.204025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.204369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.204414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.204573] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.204665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.204728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.204905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.204984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.205787] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.205787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.205787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.205787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.205787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.205787] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fa82604-1009-455c-86ec-d014497c15a6 is going to be updated. [ 1067.230410] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.230410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.230410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.230521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.231837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.231837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fa82604-1009-455c-86ec-d014497c15a6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.564821] env[68828]: INFO networking_nsxv3.common.synchronization [req-c3204e27-8c73-473c-8404-229edb9d126a req-e07014e2-05ab-4ce3-a037-302b16392757 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1067.565709] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: SUCCESS [ 1067.565911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.566492] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1067.566580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.566738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.566927] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.567044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.567111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.567264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.567478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.567478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.567581] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.568405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.568515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.568570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.568728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.568869] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.568964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.569034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.569243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.569243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.569321] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.645128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87f47227-7f82-4c5a-bf8f-4bfcdd98785f [ 1067.645282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.645377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.645429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.645613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.645697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.645792] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87f47227-7f82-4c5a-bf8f-4bfcdd98785f already deleted. [ 1067.645871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87f47227-7f82-4c5a-bf8f-4bfcdd98785f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.694499] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 4s [ 1067.864735] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.865056] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.865100] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.865898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.866232] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.866401] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.866556] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.866804] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.866954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.867189] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.867449] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.867449] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.867519] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.867631] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.867875] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.867875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.888736] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.888918] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1067.889075] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.889244] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.889514] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-31b53b80-03c4-4624-b55a-37e1562bd71d taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.889707] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.889877] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.890140] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.890286] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b53b80-03c4-4624-b55a-37e1562bd71d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.071040] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.072161] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.072161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.072374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.072542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.072542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.072732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.072817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.072879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.073024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.073100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.073220] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1068.100805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.101054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.101108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.101316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.101460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.112797] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1068.393300] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.393300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.393300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.393300] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.393500] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.393581] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 31b53b80-03c4-4624-b55a-37e1562bd71d not found, creating... [ 1068.393915] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.394106] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.394228] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.394454] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.394596] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.394877] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.395049] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.395177] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.395426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.395572] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.395716] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 31b53b80-03c4-4624-b55a-37e1562bd71d is going to be created. [ 1068.416147] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.416147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.416147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.416147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.416147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.416147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.574876] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c1aa990-7ca3-4056-913b-d8a56e8959ea: rpc.has_security_group_logging(os_id): False [ 1068.593247] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.593417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.593417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.593633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.593723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.594022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.594152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.595336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.595336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.595336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.595336] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea is going to be created. [ 1068.651393] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.651579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.651656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.652045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.652263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.662670] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: IN_PROGRESS for 2s [ 1069.104280] env[68828]: INFO networking_nsxv3.common.synchronization [req-c3204e27-8c73-473c-8404-229edb9d126a req-c0c037a8-db81-4965-89d4-fb561f045345 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1069.104497] env[68828]: INFO networking_nsxv3.common.synchronization [req-c3204e27-8c73-473c-8404-229edb9d126a req-c0c037a8-db81-4965-89d4-fb561f045345 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1069.104585] env[68828]: INFO networking_nsxv3.common.synchronization [req-c3204e27-8c73-473c-8404-229edb9d126a req-c0c037a8-db81-4965-89d4-fb561f045345 service nova] Enqueued Resource ID: 31b53b80-03c4-4624-b55a-37e1562bd71d with Priority: HIGHEST for action port [ 1069.105091] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1069.105241] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1069.105369] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b53b80-03c4-4624-b55a-37e1562bd71d with Priority: HIGHEST for action port [ 1069.106259] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.106398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.106575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.106697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.106781] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.107626] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.107741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.108806] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b53b80-03c4-4624-b55a-37e1562bd71d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.108806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.108806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.108806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.108806] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b53b80-03c4-4624-b55a-37e1562bd71d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.610610] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.610743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.610940] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31b53b80-03c4-4624-b55a-37e1562bd71d with status ACTIVE [ 1069.611115] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.611218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.611282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.611526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.611583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.611731] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.614490] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.614490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.614490] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31b53b80-03c4-4624-b55a-37e1562bd71d is going to be updated. [ 1069.632598] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.632726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.634026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.634026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.634026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.634026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b53b80-03c4-4624-b55a-37e1562bd71d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.711033] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 1069.711033] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 1069.711033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.711033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.711033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.711033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.711347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.711347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.711347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.711347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.711447] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.121208] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1070.121485] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1070.121485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.121640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.121930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.122143] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.122259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.122325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.122510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.122573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.122658] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.214138] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.625177] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.675987] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: SUCCESS [ 1070.675987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.715958] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.128098] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.219013] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.219013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.219013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.219013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.219344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.219344] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 1071.258127] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.258370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.258516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.258692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.258871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.269283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 1071.630994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.631228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.631322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.631568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.631663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.631778] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1071.657720] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.658067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.658067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.658334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.658392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.666247] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1073.280604] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 1073.280853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.281032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.281349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.281597] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.281757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.281830] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.281987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.282095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.282183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.282277] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.678531] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1073.678818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.679041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.679308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.679595] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.679734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.679802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.679979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.680134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.680207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.680245] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.784135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.784337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.784412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.784705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.784924] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.785049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.785129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.785298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.785402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.785513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.785699] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.785867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.785867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.786056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.786223] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.786314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.786376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.786519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.786595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.786677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.786769] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.107388] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1074.107522] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1074.183142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.183314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.183387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.183624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.183794] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.183897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.183980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.184151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.184244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.184334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.184480] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.184574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.184637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.184775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.184912] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.185048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.185129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.185273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.185350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.185432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.185518] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.294738] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fb8087b-3cde-4101-b157-953a51b3561f: rpc.has_security_group_logging(os_id): False [ 1074.310125] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.310125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.310298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.311020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.311020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.311020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.311020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.311020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.311274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.311440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.311584] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.311728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.311813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.312252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.312252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.312350] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.312436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.312523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.312691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.312795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.312904] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 1074.368025] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.368025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.368025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.368025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.368025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.380644] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 1074.689573] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25c2ea4d-ec48-482b-ad32-9b9a12f4793a: rpc.has_security_group_logging(os_id): False [ 1074.711011] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.711130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.711199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.711410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.711495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.711722] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.711817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.711878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.712052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.712128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.712315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.712625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.712625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.712625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.712734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.713450] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.713450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.713450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.714337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.714804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.714804] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1074.773993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.774206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.774274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.774532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.774631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.787724] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1074.927596] env[68828]: INFO networking_nsxv3.common.synchronization [req-08b3793d-efa0-46a7-a7ef-e94ea2447d8e req-687f0990-0ff9-443a-811a-c672051fb559 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1074.928053] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1074.928725] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.928725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.928725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.928909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.928945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.929057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.929182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.929346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.929429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.929521] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.234744] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.234957] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.235129] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.235456] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.235740] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.235912] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.236045] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.236324] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.236509] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.236727] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.236846] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.236961] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.237086] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.237207] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.237316] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.237452] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.255748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.255748] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.255748] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.255915] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.256128] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.256316] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.256475] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.256767] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.256911] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a7b2d96-7bc8-4679-b338-adf7911bdf2a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.436128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.436128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.436128] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 already deleted. [ 1075.436128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.739446] env[68828]: INFO networking_nsxv3.common.synchronization [req-6f42c0df-8426-49de-8a5a-916c9dd82b54 req-7fee9edd-ce5e-451d-a0ed-6fb868f86c26 tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1075.739446] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1075.739446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.739446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.739446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.740255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.741814] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.742868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.743126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.745033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.745033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.745033] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.761709] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.761709] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.761709] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.761709] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.761709] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.761709] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 2a7b2d96-7bc8-4679-b338-adf7911bdf2a not found, creating... [ 1075.763670] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.763670] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.763670] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.764275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.764275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.764463] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.764639] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.764760] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.765026] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.765199] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.765376] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 2a7b2d96-7bc8-4679-b338-adf7911bdf2a is going to be created. [ 1075.794375] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.794375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.794375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.794375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.794375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.794375] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.248284] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.394173] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 1076.394383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.672488] env[68828]: INFO networking_nsxv3.common.synchronization [req-08b3793d-efa0-46a7-a7ef-e94ea2447d8e req-6d605c2d-a2ee-42b8-a6c4-fd806dcfc50a service nova] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1076.672775] env[68828]: INFO networking_nsxv3.common.synchronization [req-08b3793d-efa0-46a7-a7ef-e94ea2447d8e req-6d605c2d-a2ee-42b8-a6c4-fd806dcfc50a service nova] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1076.672819] env[68828]: INFO networking_nsxv3.common.synchronization [req-08b3793d-efa0-46a7-a7ef-e94ea2447d8e req-6d605c2d-a2ee-42b8-a6c4-fd806dcfc50a service nova] Enqueued Resource ID: 2a7b2d96-7bc8-4679-b338-adf7911bdf2a with Priority: HIGHEST for action port [ 1076.673097] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1076.673169] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1076.673262] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7b2d96-7bc8-4679-b338-adf7911bdf2a with Priority: HIGHEST for action port [ 1076.673802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.673929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.674014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.674234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.674319] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.675218] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.675330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.675398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.675581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.675724] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.675818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.675873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.676026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.676112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.676209] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.676894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.677045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.677089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.677216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.677288] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a7b2d96-7bc8-4679-b338-adf7911bdf2a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.750489] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.802997] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1076.803849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.179218] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.179356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.180032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a7b2d96-7bc8-4679-b338-adf7911bdf2a with status ACTIVE [ 1077.180032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.180032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.180032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.180524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.180524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.180524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.180524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.180524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.180791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.180791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.180922] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.180991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.181068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.181299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.181299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.181431] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a7b2d96-7bc8-4679-b338-adf7911bdf2a is going to be updated. [ 1077.182485] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.202566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.202889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.202889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.202889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.203076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.203491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a7b2d96-7bc8-4679-b338-adf7911bdf2a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.252878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.252878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.252984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.253369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.253369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.253369] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1077.310083] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.310222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.310364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.310832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.310832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.327459] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1077.531953] env[68828]: INFO networking_nsxv3.common.synchronization [None req-7f1dbee5-daaf-435a-b18d-77ce740f0936 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_rules [ 1077.532503] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_rules [ 1077.532808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.532936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.533016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.533268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.533348] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.600898] env[68828]: INFO networking_nsxv3.common.synchronization [None req-58772a05-3aa7-4c8c-b419-294aae52bf40 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_rules [ 1077.601434] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_rules [ 1077.601798] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.601914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.685358] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.051287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.051287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.051287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.051795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.051795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.051795] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a already deleted. [ 1078.051918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.052069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.052268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.052355] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.190478] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.190478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.190478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.190478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.190478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.190478] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be created. [ 1078.216236] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.216236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.216236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.216236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.216236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.223921] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: UNINITIALIZED for 2s [ 1078.525081] env[68828]: INFO networking_nsxv3.common.synchronization [req-1057da7a-a07b-4aae-9810-f18b38ec2d22 req-488e2ab9-87ed-4858-b197-74439e67570f tempest-ServerDiskConfigTestJSON-1494549287 tempest-ServerDiskConfigTestJSON-1494549287-project-member] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1078.525636] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGHEST for action security_group_members [ 1078.525943] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.526083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.526154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.526357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.526509] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.526611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.526672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.526817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.526902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.526998] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.572456] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.572456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.572685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.572722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.572800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.572896] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a already deleted. [ 1078.572978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.028786] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.029392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.029392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.029392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.029392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.029666] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.029666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.029666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.029819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.029891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.029981] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be updated. [ 1079.059897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.060048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.060120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.060304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.060437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.068678] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: IN_PROGRESS for 2s [ 1079.337597] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1079.337597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.234411] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1080.234803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.234803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.234997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.235362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.235513] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.235591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.235773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.235863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.235955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.236066] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.737914] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.077597] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fb8087b-3cde-4101-b157-953a51b3561f in Status: SUCCESS [ 1081.077792] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f deletion is rescheduled due to dependency. [ 1081.077906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.239845] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb041b18-87bc-4915-afe4-a638542c6e17: rpc.has_security_group_logging(os_id): False [ 1081.262374] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.262519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.262559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.262771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.262866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.263138] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.263247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.263311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.263485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.263531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.263620] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be created. [ 1081.357556] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.357739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.357783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.357991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.358195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.368655] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1081.396452] env[68828]: INFO networking_nsxv3.common.synchronization [req-f52ed8cf-ed6e-4c93-a044-758045c36437 req-4868e55e-eb0a-4249-9324-6d60e756eb09 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1081.396958] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1081.397293] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.397419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.397484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.397735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.397891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.397987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.398246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.398419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.398505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.398597] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.652918] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.654028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.654028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.654028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.654028] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.654028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.654459] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.654728] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.654884] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.655135] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.655426] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.656034] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.656034] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.656034] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.656221] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.656283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.688657] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.688845] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.688990] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.689207] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.689530] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-6990f604-32e7-4c9d-9796-ab9bc4526cfd taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.689712] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.689834] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.690523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.690523] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6990f604-32e7-4c9d-9796-ab9bc4526cfd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.901062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.901240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.901290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.901475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.901571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.901770] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.901868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.901925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.902089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.902181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.902277] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 already deleted. [ 1081.902360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.193124] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.193447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.193619] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.193955] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.194170] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.194340] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 6990f604-32e7-4c9d-9796-ab9bc4526cfd not found, creating... [ 1082.194660] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.194862] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.194998] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.195292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.195490] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.195805] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.195973] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.196110] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.196332] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.196468] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.196612] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 6990f604-32e7-4c9d-9796-ab9bc4526cfd is going to be created. [ 1082.337988] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.338347] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.338508] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.338786] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.339206] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.339546] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.902194] env[68828]: INFO networking_nsxv3.common.synchronization [req-f52ed8cf-ed6e-4c93-a044-758045c36437 req-028893b0-f9bd-40cd-ba5c-956e91cf4e7f service nova] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1082.902526] env[68828]: INFO networking_nsxv3.common.synchronization [req-f52ed8cf-ed6e-4c93-a044-758045c36437 req-028893b0-f9bd-40cd-ba5c-956e91cf4e7f service nova] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1082.902724] env[68828]: INFO networking_nsxv3.common.synchronization [req-f52ed8cf-ed6e-4c93-a044-758045c36437 req-028893b0-f9bd-40cd-ba5c-956e91cf4e7f service nova] Enqueued Resource ID: 6990f604-32e7-4c9d-9796-ab9bc4526cfd with Priority: HIGHEST for action port [ 1082.906640] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1082.906799] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1082.906903] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6990f604-32e7-4c9d-9796-ab9bc4526cfd with Priority: HIGHEST for action port [ 1082.907282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.907423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.907491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.907707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.907790] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.908877] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.909071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.909177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.909378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.909574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.909680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.909760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.909878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.909961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.910110] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.910956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-6990f604-32e7-4c9d-9796-ab9bc4526cfd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.911074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.911145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.911304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.911379] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6990f604-32e7-4c9d-9796-ab9bc4526cfd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.928590] env[68828]: INFO networking_nsxv3.common.synchronization [req-044879bb-f74d-4fe2-9a8b-9983ad078959 req-20b8076b-39fd-4780-a813-e0260981a0ed tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1082.930161] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1082.930523] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.930824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.930824] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.930917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.931086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.931197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.931250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.931391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.931476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.932344] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.222668] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.222877] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.223015] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.223313] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.223579] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.223744] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.223870] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.224152] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.224285] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.224502] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.224623] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.224737] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.224851] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.224966] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.225125] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.225258] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.247921] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.248249] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.248249] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.248494] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.248735] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.248906] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.249232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.249464] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.249617] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.380222] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1083.380541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.413197] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.413490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.415222] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.416099] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6990f604-32e7-4c9d-9796-ab9bc4526cfd with status ACTIVE [ 1083.416291] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.416457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.416554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.416720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.416810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.416989] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.417595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.417595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.417595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.417595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.417595] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.417595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.418267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.418267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.418267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.418267] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6990f604-32e7-4c9d-9796-ab9bc4526cfd is going to be updated. [ 1083.434176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.434343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.434456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.434603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.438080] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.438181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.438610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.438610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.438610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.438813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6990f604-32e7-4c9d-9796-ab9bc4526cfd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.513637] env[68828]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/domains/default/security-policies/2f4a4187-5566-42ed-af79-13c7cf7b4577/rules', 'params': {'page_size': 200, 'cursor': ''}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1083.513803] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68828) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1083.671010] env[68828]: INFO networking_nsxv3.common.synchronization [req-47408a92-1809-48fb-9729-6d25f4460280 req-058b65ba-f8b5-4ff9-ac8c-57fb11cede36 tempest-ServersNegativeTestMultiTenantJSON-227251186 tempest-ServersNegativeTestMultiTenantJSON-227251186-project-member] Enqueued Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_members [ 1083.671472] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_members [ 1083.671815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.671907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.671959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.672229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.672400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.672484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.672549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.672693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.672776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.672864] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.752250] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.752532] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.752769] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.752983] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.753179] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.753348] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a not found, creating... [ 1083.753904] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.753904] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.753904] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.754263] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.754432] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.754748] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.754917] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.755760] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.756877] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.757072] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.757271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a is going to be created. [ 1083.789837] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.789837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.789837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.789837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.790117] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.790626] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.920220] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.970256] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.970464] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-825" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.970595] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-825" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.970937] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-825" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.971268] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.971473] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.971633] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.971913] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.972164] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.972394] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.972518] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.972635] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.972749] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.972863] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.972974] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.973126] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.993214] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.993426] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.993576] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.993763] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-825" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.994088] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-0b3e6154-a4c7-4e00-928b-9017309b88ac taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.994290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.994434] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.994828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.994979] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b3e6154-a4c7-4e00-928b-9017309b88ac',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.177039] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.177216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.423266] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.423957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.423957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.423957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.423957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.423957] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be created. [ 1084.445600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.445776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.445813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.446049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.446219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.455291] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: UNINITIALIZED for 2s [ 1084.497682] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.497929] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.498078] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.498383] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.498592] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.498713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 0b3e6154-a4c7-4e00-928b-9017309b88ac not found, creating... [ 1084.498981] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.499170] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.499299] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.499530] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.499677] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.499963] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.500196] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.500301] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.500516] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.500660] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.500807] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 0b3e6154-a4c7-4e00-928b-9017309b88ac is going to be created. [ 1084.518358] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.518705] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.518872] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.519160] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.519394] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.519630] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.533681] env[68828]: INFO networking_nsxv3.common.synchronization [req-044879bb-f74d-4fe2-9a8b-9983ad078959 req-f77fb7f9-0ea7-4ff1-a421-bc402a10f9ad service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1084.533850] env[68828]: INFO networking_nsxv3.common.synchronization [req-044879bb-f74d-4fe2-9a8b-9983ad078959 req-f77fb7f9-0ea7-4ff1-a421-bc402a10f9ad service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1084.533993] env[68828]: INFO networking_nsxv3.common.synchronization [req-044879bb-f74d-4fe2-9a8b-9983ad078959 req-f77fb7f9-0ea7-4ff1-a421-bc402a10f9ad service nova] Enqueued Resource ID: 096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a with Priority: HIGHEST for action port [ 1084.534295] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1084.534423] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1084.534516] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a with Priority: HIGHEST for action port [ 1084.535137] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.535291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.535363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.535556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.535653] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.536866] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.536963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.537169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.537451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.537451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.537565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.537640] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.039732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.039912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.040179] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a with status ACTIVE [ 1085.040393] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.040506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.040597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.040873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.040978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.041192] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.041300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.041387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.041555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.043836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.043836] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.043836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.043836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.043836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.043836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.043836] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a is going to be updated. [ 1085.065050] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.065166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.065936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.065936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.065936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.065936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-096c0e87-8075-4bfb-ae5d-09e8e7d6bd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.240687] env[68828]: INFO networking_nsxv3.common.synchronization [req-47408a92-1809-48fb-9729-6d25f4460280 req-0c4f8764-4e4e-4793-aa4d-8b1d60e11260 service nova] Enqueued Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_rules [ 1085.240687] env[68828]: INFO networking_nsxv3.common.synchronization [req-47408a92-1809-48fb-9729-6d25f4460280 req-0c4f8764-4e4e-4793-aa4d-8b1d60e11260 service nova] Enqueued Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_members [ 1085.240687] env[68828]: INFO networking_nsxv3.common.synchronization [req-47408a92-1809-48fb-9729-6d25f4460280 req-0c4f8764-4e4e-4793-aa4d-8b1d60e11260 service nova] Enqueued Resource ID: 0b3e6154-a4c7-4e00-928b-9017309b88ac with Priority: HIGHEST for action port [ 1085.240687] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_rules [ 1085.240687] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_members [ 1085.240687] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b3e6154-a4c7-4e00-928b-9017309b88ac with Priority: HIGHEST for action port [ 1085.241452] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.241452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.241452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.242040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.242040] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.243364] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.243466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.243638] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b3e6154-a4c7-4e00-928b-9017309b88ac taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.243743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.243802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.243972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.244060] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b3e6154-a4c7-4e00-928b-9017309b88ac',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.534427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.534768] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.534842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.534876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.535081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.535163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.535344] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1085.536242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.536415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.536506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.536680] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.536777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.536840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.537028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.537954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.538059] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40c3045-d4de-46b9-862d-aaeccc547265 already deleted. [ 1085.538735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.538735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.539222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.539422] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.539534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.539600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.539749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.539898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.540060] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.561628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.561793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.561862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.562082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.562312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.569564] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1085.745939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.746145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.746351] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b3e6154-a4c7-4e00-928b-9017309b88ac with status ACTIVE [ 1085.746548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.746658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.746726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.746940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.747085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.747228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.747310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.747370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.747653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.747653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.747773] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.747891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.747924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.748108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.748143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.748208] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b3e6154-a4c7-4e00-928b-9017309b88ac is going to be updated. [ 1085.780987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.781181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.781264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.781489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.781634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.781798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b3e6154-a4c7-4e00-928b-9017309b88ac" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.042865] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.464833] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1086.465074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.465248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.465486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.465690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.465802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.465868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.466028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.466112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.466206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.466286] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.544822] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.968533] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.046673] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.046886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.046957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.047195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.047291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.047391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40c3045-d4de-46b9-862d-aaeccc547265 is going to be created. [ 1087.085517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.085722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.085924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.086710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.086710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.097461] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40c3045-d4de-46b9-862d-aaeccc547265 in Status: UNINITIALIZED for 2s [ 1087.470848] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3199ec-0e4d-4ae9-8c43-76701bbf9090: rpc.has_security_group_logging(os_id): False [ 1087.488385] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.488385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.488385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.488524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.488554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489377] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.489377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.489377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.489377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.489581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489581] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be created. [ 1087.545413] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.545738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.545738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.545837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.546017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.555997] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1087.578021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1087.578328] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 deletion is rescheduled due to dependency. [ 1087.578461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.578626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.578998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.579425] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.579619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.579854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.580076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.580176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.580285] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.082634] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.585072] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.087411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.087593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.087669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.087914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.088032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.088156] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1089.106816] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40c3045-d4de-46b9-862d-aaeccc547265 in Status: SUCCESS [ 1089.107067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.107251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.107494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.107695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.107827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.107915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.108096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.108192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.108285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.108378] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.116575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.116575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.116794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.116991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.117085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.125095] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1089.501660] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c2d2a2b0-9502-4b6c-8fd2-f390fefbdfee tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1089.502103] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1089.502454] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.502749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.568905] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1089.569207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.613233] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.613620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.613620] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.614154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.614154] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.614394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.614394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.614559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.614663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.614783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.615130] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.615130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.615275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.615429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.615606] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.615708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.615771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.616056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.616056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.616387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.616526] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.122521] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a40c3045-d4de-46b9-862d-aaeccc547265: rpc.has_security_group_logging(os_id): False [ 1090.139152] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.139306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.139376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.140176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.140176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.140176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.140176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.140176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.140429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.140429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.140566] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.140663] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.140728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.140870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.140944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.141148] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.141243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.141307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.141446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.141519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.141605] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a40c3045-d4de-46b9-862d-aaeccc547265 is going to be created. [ 1090.204339] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.204495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.204571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.204789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.204967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.215054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a40c3045-d4de-46b9-862d-aaeccc547265 in Status: IN_PROGRESS for 2s [ 1091.135784] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1091.135784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.135784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.135784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.136164] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.140570] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.140570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.140570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.140570] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.524321] env[68828]: INFO networking_nsxv3.common.synchronization [req-519e700c-edca-4401-b0ae-02feae8f7d14 req-3ad891c0-463f-4c90-ad58-c6c535cdc2cb tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_members [ 1091.524835] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_members [ 1091.525338] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.525338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.525338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.525674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.525827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.525943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.526057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.526429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.526429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.526429] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.641086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.641238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.641470] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.684016] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.684160] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.684317] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.684611] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.684979] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.687093] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.687093] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.687093] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.687093] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.687093] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.687093] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.687093] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.687093] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.687093] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.687093] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.687093] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.705378] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.705587] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.705777] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.706065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.706465] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-485282b4-0e2e-4414-8144-eb9d16c9c2cc taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.706670] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.706807] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.707203] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.707350] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('485282b4-0e2e-4414-8144-eb9d16c9c2cc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.930265] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.930488] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.930634] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.930985] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.931296] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.931502] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.931627] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.931876] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.932088] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.932353] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.932494] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.932613] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.932753] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.932872] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.933007] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.933189] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.949862] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.950059] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.950210] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.950393] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.950711] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-ad699468-ebfb-4f80-8ea6-522b9f428e86 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.950886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.951015] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.951361] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.951510] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad699468-ebfb-4f80-8ea6-522b9f428e86',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.028790] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.028790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.028790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.028790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.029299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.029299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.029299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.029299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.029540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.029540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.029845] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a already deleted. [ 1092.029845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.144618] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.210029] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.210296] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.210433] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.210733] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.210902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.211084] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 485282b4-0e2e-4414-8144-eb9d16c9c2cc not found, creating... [ 1092.211358] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.211577] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.211738] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.211976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.212136] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.212433] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.212591] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.212714] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.212927] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.213081] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.213231] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 485282b4-0e2e-4414-8144-eb9d16c9c2cc is going to be created. [ 1092.229595] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a40c3045-d4de-46b9-862d-aaeccc547265 in Status: SUCCESS [ 1092.229825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.238441] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.238676] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.238806] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.239106] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.239345] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.239587] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.454575] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.454856] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.455037] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.455386] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.455557] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.455731] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port ad699468-ebfb-4f80-8ea6-522b9f428e86 not found, creating... [ 1092.456032] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.456213] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.456339] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.456603] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.456762] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.457323] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.457557] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.457642] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.457895] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.457984] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.458144] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: ad699468-ebfb-4f80-8ea6-522b9f428e86 is going to be created. [ 1092.495610] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.495845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.495958] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.496250] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.496481] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.496741] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.648608] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.648841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.648921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.649202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.649324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.649455] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1092.689035] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.689243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.689384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.689690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.689900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.698953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1093.200264] env[68828]: INFO networking_nsxv3.common.synchronization [req-519e700c-edca-4401-b0ae-02feae8f7d14 req-71a11381-9ca9-41d0-a307-0ea97d8cc36d service nova] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_rules [ 1093.200264] env[68828]: INFO networking_nsxv3.common.synchronization [req-519e700c-edca-4401-b0ae-02feae8f7d14 req-71a11381-9ca9-41d0-a307-0ea97d8cc36d service nova] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_members [ 1093.200264] env[68828]: INFO networking_nsxv3.common.synchronization [req-519e700c-edca-4401-b0ae-02feae8f7d14 req-71a11381-9ca9-41d0-a307-0ea97d8cc36d service nova] Enqueued Resource ID: ad699468-ebfb-4f80-8ea6-522b9f428e86 with Priority: HIGHEST for action port [ 1093.200264] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_rules [ 1093.200264] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_members [ 1093.200264] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad699468-ebfb-4f80-8ea6-522b9f428e86 with Priority: HIGHEST for action port [ 1093.200949] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.201222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.201502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.201807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.202033] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.203590] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.203881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.205112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.205112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.205112] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.205112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.205112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.205798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.206234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.206668] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.207949] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad699468-ebfb-4f80-8ea6-522b9f428e86 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.209549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.209549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.209549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.209549] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad699468-ebfb-4f80-8ea6-522b9f428e86',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.215283] env[68828]: INFO networking_nsxv3.common.synchronization [req-5c585557-3931-46e1-80f7-2538303a44e9 req-23d3012c-4fb4-440f-9b9f-d8b3d45398bb service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1093.215485] env[68828]: INFO networking_nsxv3.common.synchronization [req-5c585557-3931-46e1-80f7-2538303a44e9 req-23d3012c-4fb4-440f-9b9f-d8b3d45398bb service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1093.215642] env[68828]: INFO networking_nsxv3.common.synchronization [req-5c585557-3931-46e1-80f7-2538303a44e9 req-23d3012c-4fb4-440f-9b9f-d8b3d45398bb service nova] Enqueued Resource ID: 485282b4-0e2e-4414-8144-eb9d16c9c2cc with Priority: HIGHEST for action port [ 1093.215875] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1093.220021] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1093.220021] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 485282b4-0e2e-4414-8144-eb9d16c9c2cc with Priority: HIGHEST for action port [ 1093.220021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.220021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.220021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.220021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.220021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-485282b4-0e2e-4414-8144-eb9d16c9c2cc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.220021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.220021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.220021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.220021] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('485282b4-0e2e-4414-8144-eb9d16c9c2cc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.714788] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.715856] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad699468-ebfb-4f80-8ea6-522b9f428e86 with status ACTIVE [ 1093.716172] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.716378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.716508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.716850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.716994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.717287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.717453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.717557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.717797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.718953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.719403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.719616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.719714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.719923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.720139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.720234] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad699468-ebfb-4f80-8ea6-522b9f428e86 is going to be updated. [ 1093.721862] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.722026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.734437] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 485282b4-0e2e-4414-8144-eb9d16c9c2cc with status ACTIVE [ 1093.734756] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.734961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.735099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.735408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.735652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.735825] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.735985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.736110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.736359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.736460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.736860] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.736860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.736860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.737017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.737017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.737118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 485282b4-0e2e-4414-8144-eb9d16c9c2cc is going to be updated. [ 1093.741763] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.741878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.742053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.742111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.742241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.742463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad699468-ebfb-4f80-8ea6-522b9f428e86" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.757277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.757384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.757638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.757774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-485282b4-0e2e-4414-8144-eb9d16c9c2cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.223561] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.614154] env[68828]: INFO networking_nsxv3.common.synchronization [None req-ca69422a-61ea-4202-8672-a30892e934aa None None] Enqueued Resource ID: 0f41b20f-cc95-4b92-92eb-8d7400d5b540 with Priority: HIGHEST for action port [ 1094.617087] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f41b20f-cc95-4b92-92eb-8d7400d5b540 with Priority: HIGHEST for action port [ 1094.617087] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f41b20f-cc95-4b92-92eb-8d7400d5b540 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.617300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f41b20f-cc95-4b92-92eb-8d7400d5b540" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.617385] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f41b20f-cc95-4b92-92eb-8d7400d5b540" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.617734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f41b20f-cc95-4b92-92eb-8d7400d5b540" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.618403] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f41b20f-cc95-4b92-92eb-8d7400d5b540',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.710663] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 4s [ 1094.729832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.729993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.730076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.730299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.730389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.730500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a is going to be created. [ 1094.753126] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.753271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.753407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.753632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.753805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.761948] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a in Status: UNINITIALIZED for 2s [ 1095.121530] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f41b20f-cc95-4b92-92eb-8d7400d5b540 [ 1095.121651] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.121809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.121894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.122134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.122254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.122406] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f41b20f-cc95-4b92-92eb-8d7400d5b540 already deleted. [ 1095.122516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f41b20f-cc95-4b92-92eb-8d7400d5b540" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.405086] env[68828]: INFO networking_nsxv3.common.synchronization [req-ad1f6dfe-e200-4454-84c5-10f4034efd93 req-d5167dc2-1fae-4929-9b4e-75d50477ab64 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1095.406162] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1095.406162] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.406162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.406162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.406409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.406440] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.406548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.406611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.406782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.406870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.407259] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.909623] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.909778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.909778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.909996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.910106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.910291] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.910396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.910485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.910707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.910707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.910839] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1095.940207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.940207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.940207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.940422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.940504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.948948] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1096.720949] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.724019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.724019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.724019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.724019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.724990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.725208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.725403] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.728024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.728024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.728024] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.728024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.728024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.728024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.728024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.728024] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.746789] env[68828]: INFO networking_nsxv3.common.synchronization [req-50b21b1f-989f-4148-9116-7c6bce118951 req-e7d3395b-e9e1-4c69-92b3-c34f37a46bae tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1096.746789] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1096.747388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.747388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.747480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.748310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.748310] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.748310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.748310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.748310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.748310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.748310] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.781549] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a in Status: SUCCESS [ 1096.781772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.781934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.782216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.782473] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.782611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.782680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.782833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.782913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.783032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.783137] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.785880] env[68828]: INFO networking_nsxv3.common.synchronization [req-b366722e-0017-4556-9df6-e4c80c8de992 req-48b9cf4d-6b20-4d03-a5cc-380693854287 tempest-ServersNegativeTestMultiTenantJSON-227251186 tempest-ServersNegativeTestMultiTenantJSON-227251186-project-member] Enqueued Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_members [ 1096.786501] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGHEST for action security_group_members [ 1096.786814] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.786930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.786994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.787174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.787323] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.787466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.787635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.787635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.787727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.787762] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.896845] env[68828]: INFO networking_nsxv3.common.synchronization [None req-91c08522-fff9-420a-9dad-3383724e9271 None None] Enqueued Resource ID: 0f82bbaf-07d3-421e-a7ff-4c903ce9f39e with Priority: HIGHEST for action port [ 1096.897018] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f82bbaf-07d3-421e-a7ff-4c903ce9f39e with Priority: HIGHEST for action port [ 1096.897574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f82bbaf-07d3-421e-a7ff-4c903ce9f39e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.897696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f82bbaf-07d3-421e-a7ff-4c903ce9f39e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.897765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f82bbaf-07d3-421e-a7ff-4c903ce9f39e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.898044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f82bbaf-07d3-421e-a7ff-4c903ce9f39e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.898576] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f82bbaf-07d3-421e-a7ff-4c903ce9f39e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.043181] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.043424] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.043566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.043867] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.044165] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.044379] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.044518] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.044765] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.044937] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.045856] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.045995] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.046195] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.046329] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.046455] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.046571] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.046713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.067022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.067022] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.067022] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.067022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.067022] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c9855a3b-785e-4a9c-b27b-93314ce943fa taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.067022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.067022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.067022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.067438] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9855a3b-785e-4a9c-b27b-93314ce943fa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.229842] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f4a4187-5566-42ed-af79-13c7cf7b4577: rpc.has_security_group_logging(os_id): False [ 1097.231235] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.249033] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.249182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.249227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.250117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.250117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.250117] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.250117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.250117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.250117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.250117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.250389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.250389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.250389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.250541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.250619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.250791] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.250881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.250933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.251090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.251165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.251247] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1097.252611] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.285474] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.289739] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.289739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.289739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.289936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.290769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.290769] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.290769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.290769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.290769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.290769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.291157] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40c3045-d4de-46b9-862d-aaeccc547265 is going to be updated. [ 1097.316517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.316517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.316517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.316887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.316887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.319846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.319846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.319846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.319846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.320069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.329873] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40c3045-d4de-46b9-862d-aaeccc547265 in Status: IN_PROGRESS for 2s [ 1097.332989] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1097.401663] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f82bbaf-07d3-421e-a7ff-4c903ce9f39e [ 1097.401912] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.402065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.402140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.402414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.402516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.402613] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f82bbaf-07d3-421e-a7ff-4c903ce9f39e already deleted. [ 1097.402696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f82bbaf-07d3-421e-a7ff-4c903ce9f39e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.569457] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.569713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.569822] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.570162] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.570326] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.570489] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c9855a3b-785e-4a9c-b27b-93314ce943fa not found, creating... [ 1097.570751] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.570918] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.571061] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.571288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.571468] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.571767] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.571939] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.572656] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.572930] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.573093] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.573244] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c9855a3b-785e-4a9c-b27b-93314ce943fa is going to be created. [ 1097.591864] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.592146] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.592252] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.592600] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.592854] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.593108] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.733680] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.755899] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.790504] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a: rpc.has_security_group_logging(os_id): False [ 1097.813018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.813018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.813018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.813278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.813278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.813524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.813629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.813693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.813846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.813922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.814014] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a is going to be created. [ 1097.870636] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.870816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.870885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.871163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.871382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.881836] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a in Status: IN_PROGRESS for 2s [ 1097.959126] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1097.959321] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1097.959452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.236037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.236179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.236276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.236546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.236651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.236756] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1098.257846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.258067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.258067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.258312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.258380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.258462] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1098.267169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.267340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.267400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.267563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.267705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.276497] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1098.303064] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.303064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.303064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.303260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.303408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.312622] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1098.445415] env[68828]: INFO networking_nsxv3.common.synchronization [req-50b21b1f-989f-4148-9116-7c6bce118951 req-fb33dd22-7f5b-4251-9d1c-0e80dfabe506 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1098.445657] env[68828]: INFO networking_nsxv3.common.synchronization [req-50b21b1f-989f-4148-9116-7c6bce118951 req-fb33dd22-7f5b-4251-9d1c-0e80dfabe506 service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1098.445849] env[68828]: INFO networking_nsxv3.common.synchronization [req-50b21b1f-989f-4148-9116-7c6bce118951 req-fb33dd22-7f5b-4251-9d1c-0e80dfabe506 service nova] Enqueued Resource ID: c9855a3b-785e-4a9c-b27b-93314ce943fa with Priority: HIGHEST for action port [ 1098.446056] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1098.446187] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1098.446283] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9855a3b-785e-4a9c-b27b-93314ce943fa with Priority: HIGHEST for action port [ 1098.447259] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.447406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.447478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.447679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.447762] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.448597] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.448690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.448916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9855a3b-785e-4a9c-b27b-93314ce943fa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.449035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.449103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.449262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.449336] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9855a3b-785e-4a9c-b27b-93314ce943fa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.951349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.951793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.952853] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9855a3b-785e-4a9c-b27b-93314ce943fa with status ACTIVE [ 1098.953094] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.953182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.953237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.953439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.953529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.953697] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.953839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.953839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.953997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.954085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.954260] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.954406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.954464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.954603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.954695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.954758] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9855a3b-785e-4a9c-b27b-93314ce943fa is going to be updated. [ 1098.975245] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.975245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.975433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.975645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.975832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.976046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9855a3b-785e-4a9c-b27b-93314ce943fa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.341700] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a40c3045-d4de-46b9-862d-aaeccc547265 in Status: SUCCESS [ 1099.341700] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a40c3045-d4de-46b9-862d-aaeccc547265 deletion is rescheduled due to dependency. [ 1099.341700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.345084] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1099.345084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.345084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.345255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.345349] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.847937] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.848180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.899261] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a in Status: SUCCESS [ 1099.899538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.285698] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1100.285952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.286237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.286452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.286656] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.286779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.286857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.287030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.287128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.287219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.287312] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.320801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1100.321078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.321219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.321436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.321650] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.321777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.321846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.322043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.322105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.322197] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.789574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.789770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.789828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.790079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.790261] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.790362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.790434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.790592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.790682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.790773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.790936] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.791056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.791118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.791260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.791398] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.791491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.791552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.791686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.791761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.791840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.791927] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.825172] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.297618] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f4a4187-5566-42ed-af79-13c7cf7b4577: rpc.has_security_group_logging(os_id): False [ 1101.315145] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.315293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.315365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.315732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.315853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.316088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.316202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.316269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.316440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.316530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.316746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.316832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.316893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.317362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.317467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.317654] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.317749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.317811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.317954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.318041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.318125] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1101.327975] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.374642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.374809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.374809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.375055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.375213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.388963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1101.830654] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.830872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.830919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.831175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.831267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.831373] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1101.876622] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.876766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.876864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.877064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.877369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.893996] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1103.295651] env[68828]: INFO networking_nsxv3.common.synchronization [req-47c8650b-54aa-43bf-aa54-e842e4cd2b67 req-d892c8b7-83fe-4514-8b1e-f4c361f33ce0 tempest-ServerGroupTestJSON-641623734 tempest-ServerGroupTestJSON-641623734-project-member] Enqueued Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_members [ 1103.296191] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_members [ 1103.296489] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.296608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.296670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.296902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.297137] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.297198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.297238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.297360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.297444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.297535] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.404274] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1103.404274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.710155] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.710413] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-984" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.710607] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-984" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.711194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-984" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.711423] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.711589] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.711783] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.712072] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.712292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.712598] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.712782] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.712951] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.713134] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.713313] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.713479] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.713672] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.731657] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.731859] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1103.732029] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.732288] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-984" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.732602] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-1fa6a82c-3486-4bea-bd49-e560e85e05f1 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.732787] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.732913] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.733267] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.733470] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa6a82c-3486-4bea-bd49-e560e85e05f1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.800994] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.801816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.801953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.802228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.802327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.802930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.802930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.802930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.802930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.803186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.803186] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c already deleted. [ 1103.803186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.904126] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1103.904386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.904586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.904805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.905027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.905146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.905214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.905389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.905476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.905580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.905683] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.235661] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.235906] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.236054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.236412] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.236630] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.236836] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 1fa6a82c-3486-4bea-bd49-e560e85e05f1 not found, creating... [ 1104.237106] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.237268] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.237403] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.237678] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.237841] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.238145] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.238313] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.238438] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.238704] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.238898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.239071] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 1fa6a82c-3486-4bea-bd49-e560e85e05f1 is going to be created. [ 1104.268247] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.268452] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.268672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.268968] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.269255] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.269513] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.409960] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.410384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.410384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.410478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.410599] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.410796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.410873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.411046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.411139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.411231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.411384] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.411473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.411534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.411669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.411804] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.411891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.411997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.412099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.412218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.412264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.412430] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.914868] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 1104.937714] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.937929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.938010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.938294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.938395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.939063] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.939063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.939063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.939063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.939063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.939301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.939301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.939386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.939592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.939735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.939951] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.940052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.940117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.940280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.940360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.940443] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1105.013553] env[68828]: INFO networking_nsxv3.common.synchronization [req-47c8650b-54aa-43bf-aa54-e842e4cd2b67 req-8f5fb4e1-b484-404d-87da-c903d8a3b0bb service nova] Enqueued Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_rules [ 1105.013553] env[68828]: INFO networking_nsxv3.common.synchronization [req-47c8650b-54aa-43bf-aa54-e842e4cd2b67 req-8f5fb4e1-b484-404d-87da-c903d8a3b0bb service nova] Enqueued Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_members [ 1105.013553] env[68828]: INFO networking_nsxv3.common.synchronization [req-47c8650b-54aa-43bf-aa54-e842e4cd2b67 req-8f5fb4e1-b484-404d-87da-c903d8a3b0bb service nova] Enqueued Resource ID: 1fa6a82c-3486-4bea-bd49-e560e85e05f1 with Priority: HIGHEST for action port [ 1105.013976] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_rules [ 1105.014123] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_members [ 1105.014217] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fa6a82c-3486-4bea-bd49-e560e85e05f1 with Priority: HIGHEST for action port [ 1105.014534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.014705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.014748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.014994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.018133] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.019077] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.019196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.019260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.019440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.019585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.021407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.021407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.021407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.021407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.021576] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.022947] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fa6a82c-3486-4bea-bd49-e560e85e05f1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.022947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.022947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.022947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.023779] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa6a82c-3486-4bea-bd49-e560e85e05f1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.027327] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.027715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.027810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.028269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.028269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.054672] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1105.525176] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.525176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.525474] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.526508] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fa6a82c-3486-4bea-bd49-e560e85e05f1 with status ACTIVE [ 1105.530022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.530022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.530022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.530022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.530022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fa6a82c-3486-4bea-bd49-e560e85e05f1 is going to be updated. [ 1105.549020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.549203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.549243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.549483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.549970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.549970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fa6a82c-3486-4bea-bd49-e560e85e05f1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.031131] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.534399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.534399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.534399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.534730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.534913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.535021] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c is going to be created. [ 1106.558701] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.558871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.558917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.559290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.559290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.567670] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c in Status: UNINITIALIZED for 2s [ 1106.638242] env[68828]: INFO networking_nsxv3.common.synchronization [req-53d60a9e-d5c2-4fed-afba-62771c8ebf1c req-069acf39-4356-454a-a7ec-67c4adfb63f8 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1106.638773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1106.639137] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.639260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.639376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.639528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.639680] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.639781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.639845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.639977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.640781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.640922] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.682578] env[68828]: INFO networking_nsxv3.common.synchronization [req-70b31de4-58a1-4a4c-92a5-db45f363d732 req-2668bcf4-165b-4405-bc5c-60c4628f7ff3 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1106.683571] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1106.683893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.684096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.684198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.684456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.684687] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.684822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.684907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.685101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.685219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.685335] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.069371] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1107.069725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.142967] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.189964] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.189964] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.189964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.189964] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1107.214762] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.214916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.214992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.215210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.215352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.224485] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1107.292191] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.292406] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.292540] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.292819] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.293102] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.293265] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.293389] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.293612] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.293970] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.294233] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.294351] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.294450] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.294613] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.294790] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.294912] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.295092] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.299253] env[68828]: INFO networking_nsxv3.common.synchronization [None req-0e3f7395-cc3c-4fdf-b6eb-2afe5de6059f tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1107.299836] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1107.302101] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.302101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.313162] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.313407] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.313515] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.313740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.314372] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.314652] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.315092] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.315813] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.316008] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e954e0ad-fdc7-4397-b4cc-ef35b2174c59',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.645701] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.818378] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.818631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.818783] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.819050] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.819216] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.819377] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port e954e0ad-fdc7-4397-b4cc-ef35b2174c59 not found, creating... [ 1107.819643] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.819807] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.819931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.820180] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.820324] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.820604] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.820763] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.820902] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.821505] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.821693] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.821845] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: e954e0ad-fdc7-4397-b4cc-ef35b2174c59 is going to be created. [ 1107.844037] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.844163] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.844381] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.844923] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.845194] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.845425] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.148545] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.148814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.148814] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.148994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.149105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.149211] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1108.206876] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.207067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.207109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.208471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.208471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.215923] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1108.580231] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c in Status: SUCCESS [ 1108.580339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.580562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.580761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.580958] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.581091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.581156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.581302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.581386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.581483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.583246] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.640205] env[68828]: INFO networking_nsxv3.common.synchronization [req-bb89f60b-d1f3-4dc3-82a3-38cc9a44c65a req-c742187c-8e59-4bdc-92d3-3100ff7decdf tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1108.640715] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1108.641728] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.641882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.641882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.642143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.642314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.642420] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.643454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.643660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.643796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.643933] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.719547] env[68828]: INFO networking_nsxv3.common.synchronization [req-70b31de4-58a1-4a4c-92a5-db45f363d732 req-f512102c-22e4-485c-8ee2-eb536bd617b8 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1108.719811] env[68828]: INFO networking_nsxv3.common.synchronization [req-70b31de4-58a1-4a4c-92a5-db45f363d732 req-f512102c-22e4-485c-8ee2-eb536bd617b8 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1108.719944] env[68828]: INFO networking_nsxv3.common.synchronization [req-70b31de4-58a1-4a4c-92a5-db45f363d732 req-f512102c-22e4-485c-8ee2-eb536bd617b8 service nova] Enqueued Resource ID: e954e0ad-fdc7-4397-b4cc-ef35b2174c59 with Priority: HIGHEST for action port [ 1108.720470] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1108.720562] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1108.720667] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e954e0ad-fdc7-4397-b4cc-ef35b2174c59 with Priority: HIGHEST for action port [ 1108.721149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.721273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.721337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.721532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.721598] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.722505] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.722657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.722835] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.722955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.723037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.723208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.723284] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e954e0ad-fdc7-4397-b4cc-ef35b2174c59',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.088957] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.088957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.088957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.088957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.089273] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.089273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.089273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.089423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.089515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.089605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.089756] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.089877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.089944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090239] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.090329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.090389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.090678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.090766] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.146202] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.224428] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.224628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.227317] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e954e0ad-fdc7-4397-b4cc-ef35b2174c59 with status ACTIVE [ 1109.227614] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.227829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.227992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.228259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.228392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.228524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.228677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.228770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.229019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.229184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.229447] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.229607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.229762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.229938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.230514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.230672] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e954e0ad-fdc7-4397-b4cc-ef35b2174c59 is going to be updated. [ 1109.239799] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1109.240136] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1109.240442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.241060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.241363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.241977] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.241977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.241977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.242271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.242390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.242501] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.259392] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.259535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.259609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.259953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.260080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.260246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e954e0ad-fdc7-4397-b4cc-ef35b2174c59" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.594278] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c: rpc.has_security_group_logging(os_id): False [ 1109.610380] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.610380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.610380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.610526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.610612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.611099] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.611215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.611280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.611452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.611539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.611723] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.611943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.612027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.612184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.612261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.612457] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.612539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.612602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.612741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.612816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.612900] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c is going to be created. [ 1109.648723] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.670111] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.670319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.670368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.670544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.670722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.681835] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c in Status: IN_PROGRESS for 2s [ 1109.744773] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.944140] env[68828]: INFO networking_nsxv3.common.synchronization [req-307fe26c-08c4-4ca3-8d26-7cfb52d54bee req-37cdeeb0-116a-48ab-9939-864eca28a3b0 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_members [ 1109.944805] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGHEST for action security_group_members [ 1109.945072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.945244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.945347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.945594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.946018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.946018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.946018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.946190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.946314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.946420] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.151573] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.151816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.151816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.152054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.152149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.152258] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1110.181431] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.181431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.181630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.181794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.182490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.191247] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1110.224850] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1110.225151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.225313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.225536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.225733] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.225873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.225943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.226145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.226980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.226980] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.251031] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.448600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.448918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.448918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.449074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.449177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.449386] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.449492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.449557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.449716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.449796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.449888] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a is going to be updated. [ 1110.478728] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.478931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.478931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.479119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.479276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.488068] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e89052b-2796-4bf5-84ca-4753e088c73a in Status: IN_PROGRESS for 2s [ 1110.728790] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.729026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.729026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.729175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.729351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.730015] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.730015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.730015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.730015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.730015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.730015] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1110.751973] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.752331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.752331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.752596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.752668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.753391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1110.782263] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.783331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.783331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.783331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.783331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.811526] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1110.826987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.827163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.827251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.827526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.827707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.839370] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1111.695059] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c in Status: SUCCESS [ 1111.695059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.206463] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1112.206768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.499380] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e89052b-2796-4bf5-84ca-4753e088c73a in Status: SUCCESS [ 1112.499577] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a deletion is rescheduled due to dependency. [ 1112.499696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.821536] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1112.821801] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 deletion is rescheduled due to dependency. [ 1112.821934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.848689] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1112.848942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.849151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.849377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.849579] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.849698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.849766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.849922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.850017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.850198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.850198] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.353086] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.353467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.353467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.353603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.353790] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.353889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.353959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.354109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.354206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.354321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.354536] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.354689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.354761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.354862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.355012] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.355119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.355177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.355301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.355361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.355446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.355616] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.858570] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25c2ea4d-ec48-482b-ad32-9b9a12f4793a: rpc.has_security_group_logging(os_id): False [ 1113.878808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.878808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.878808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.878808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.878808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.878808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.878808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.878808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.879182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.879182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.879182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.879288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.879321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.879455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.879846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.879846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.879846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.879846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.880234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.880234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.880234] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1113.982688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.982864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.982934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.983166] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.983361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.003509] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1114.721260] env[68828]: INFO networking_nsxv3.common.synchronization [None req-e3a99c1d-2080-41c3-89f4-796aee10c99e tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1114.721540] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1114.721859] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.721978] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.722054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.722306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.722387] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.792403] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a99ec5b0-450a-41c5-b00d-f87a1d5ae535 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1114.792403] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1114.792675] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.792777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.247156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.247156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.247156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.247383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.247383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.247448] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54442a91-18b6-4b09-9577-94704b92215d already deleted. [ 1115.247521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.247671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.247821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.247907] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.769718] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.770090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.770090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.770090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.770199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.770306] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54442a91-18b6-4b09-9577-94704b92215d already deleted. [ 1115.770394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.018923] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1116.019289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.206551] env[68828]: INFO networking_nsxv3.common.synchronization [req-3cc64c8d-7467-44fd-8b2e-466e94504c4a req-67273e4f-8789-4f62-bebf-2ce975bb3103 tempest-ServerGroupTestJSON-641623734 tempest-ServerGroupTestJSON-641623734-project-member] Enqueued Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_members [ 1117.206551] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGHEST for action security_group_members [ 1117.206811] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.207172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.207254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.207488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.207614] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.207786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.207848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.208000] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.208095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.208185] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.355278] env[68828]: INFO networking_nsxv3.common.synchronization [req-900cf45a-e273-4844-a4e8-29b9ec2dedcd req-0eaf0eed-11a2-4757-8e7f-0341fc99b6ac tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1117.355829] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1117.356155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.356278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.356347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.356548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.356706] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.356805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.356864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.357077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.357206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.357272] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.627200] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.627821] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.627821] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.627821] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.628051] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.628207] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.629304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.629304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.629304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.629304] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.629304] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.629304] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.629620] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.629620] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.629620] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.629782] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.649049] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.649185] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.649309] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.650324] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-860" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.650666] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-4268861f-767c-49c7-9045-cfb45ba2804c taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.650855] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.650987] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.651344] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.651494] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4268861f-767c-49c7-9045-cfb45ba2804c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.710750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.710948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.711047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.711278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.711384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.711588] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.711808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.711808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.711924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.712010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.712106] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c is going to be updated. [ 1117.745699] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.745840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.745902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.746123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.746285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.755942] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c in Status: IN_PROGRESS for 2s [ 1117.859413] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.153656] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.153886] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.154034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.154403] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.154553] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.154747] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 4268861f-767c-49c7-9045-cfb45ba2804c not found, creating... [ 1118.155039] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.155213] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.155355] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.155633] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.155783] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.156087] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.156253] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.156377] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.156593] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.156735] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.156883] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 4268861f-767c-49c7-9045-cfb45ba2804c is going to be created. [ 1118.210067] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.210333] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.210450] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.210801] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.211082] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.211325] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.361411] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.864371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.864541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.864617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.864928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.865040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.865136] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1118.874142] env[68828]: INFO networking_nsxv3.common.synchronization [req-900cf45a-e273-4844-a4e8-29b9ec2dedcd req-eebd75c2-5406-4679-9b32-6992f1cea1ca service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1118.874142] env[68828]: INFO networking_nsxv3.common.synchronization [req-900cf45a-e273-4844-a4e8-29b9ec2dedcd req-eebd75c2-5406-4679-9b32-6992f1cea1ca service nova] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1118.874142] env[68828]: INFO networking_nsxv3.common.synchronization [req-900cf45a-e273-4844-a4e8-29b9ec2dedcd req-eebd75c2-5406-4679-9b32-6992f1cea1ca service nova] Enqueued Resource ID: 4268861f-767c-49c7-9045-cfb45ba2804c with Priority: HIGHEST for action port [ 1118.874142] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_rules [ 1118.874142] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1118.874142] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4268861f-767c-49c7-9045-cfb45ba2804c with Priority: HIGHEST for action port [ 1118.874386] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.874386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.874465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.874656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.874772] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.876338] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.876338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.877142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4268861f-767c-49c7-9045-cfb45ba2804c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.877142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.877142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.877142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.877142] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4268861f-767c-49c7-9045-cfb45ba2804c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.896415] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.897148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.897148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.897148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.897148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.906889] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1119.379537] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.379979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.379979] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4268861f-767c-49c7-9045-cfb45ba2804c with status ACTIVE [ 1119.380119] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.380201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.380246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.380422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.380510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.380680] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.380778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.380842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.380997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.381089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.381342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.381469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.381530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.381678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.381768] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.381858] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4268861f-767c-49c7-9045-cfb45ba2804c is going to be updated. [ 1119.402350] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.402530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.402624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.402900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.403058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.403228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4268861f-767c-49c7-9045-cfb45ba2804c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.765110] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c in Status: SUCCESS [ 1119.765297] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c deletion is rescheduled due to dependency. [ 1119.765414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.210202] env[68828]: INFO networking_nsxv3.common.synchronization [req-58bdfb84-b34a-43af-ba17-fa20b83dc8cf req-2f79d414-9e00-444e-8b50-1014bf67489d tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1120.210747] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1120.211142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.211286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.211352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.211662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.211835] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.211937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.212032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.212177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.212262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.212365] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.524989] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.524989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.524989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.524989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.525447] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.525447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.525779] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.525926] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.526160] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.526497] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.526710] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.526774] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.526920] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.527082] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.527245] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.527419] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.545539] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.545539] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.545744] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.545840] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.546199] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.546384] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.546510] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.546863] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.547058] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.715052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.715327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.715475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.715815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.715971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.716277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.716403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.716492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.716722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.716858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.717041] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d already deleted. [ 1120.717229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.917221] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1120.917913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.917913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.917913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.918103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.919032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.919032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.919032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.919032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.919032] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.049479] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.049835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.050322] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.050467] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.051376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.051376] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 not found, creating... [ 1121.051376] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.051608] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.051732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.052045] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.052283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.052647] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.052931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.052998] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.053306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.053569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.053661] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 is going to be created. [ 1121.072323] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.072574] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.072772] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.073087] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.073404] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.073683] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.421580] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.786800] env[68828]: INFO networking_nsxv3.common.synchronization [req-58bdfb84-b34a-43af-ba17-fa20b83dc8cf req-7de01641-ce29-4f17-9106-4fc740759607 service nova] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1121.787132] env[68828]: INFO networking_nsxv3.common.synchronization [req-58bdfb84-b34a-43af-ba17-fa20b83dc8cf req-7de01641-ce29-4f17-9106-4fc740759607 service nova] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1121.787209] env[68828]: INFO networking_nsxv3.common.synchronization [req-58bdfb84-b34a-43af-ba17-fa20b83dc8cf req-7de01641-ce29-4f17-9106-4fc740759607 service nova] Enqueued Resource ID: c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 with Priority: HIGHEST for action port [ 1121.787784] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1121.787968] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1121.788148] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 with Priority: HIGHEST for action port [ 1121.788409] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.788574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.788747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.788866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.788957] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.789907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.790626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.790626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.790626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.790626] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.790626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.790626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.791011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.791011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.791011] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.791760] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.791873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.791951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.795322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.795322] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.924645] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.294402] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.295528] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.295675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.297230] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 with status ACTIVE [ 1122.297420] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.297573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.297665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.297808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.297908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.298088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.298170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.298228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.298381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.298459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.298637] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.298728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.298864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.298936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.299028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.299095] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0 is going to be updated. [ 1122.481802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.481945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.482028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.482240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.482373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.482517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c10de0fe-7fcb-4ec7-8e68-f101d94ba8b0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.483195] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.483307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.483479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.483529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.483611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.483700] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1122.544284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.544529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.544634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.544968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.545470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.554916] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1122.797058] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.300485] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.300597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.300597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.300887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.301091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.301226] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be created. [ 1123.330603] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.330887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.331028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.331284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.331454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.343631] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: UNINITIALIZED for 2s [ 1124.565417] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1124.565953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.566277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.566486] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.566609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.566676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.566885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.568212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.568212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.568212] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.069591] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.069591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.069828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.069866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.070092] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.070198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.070262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.070419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.070509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.070619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.070771] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.070863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.071049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.071119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.071256] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.071358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.071518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.071561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.071645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.071752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.071851] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.354393] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1125.354648] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.354870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.355152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.355347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.355461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.355541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.355670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.355870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.355870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.356068] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.574499] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37ec0117-a289-428f-9466-58f2541a90c7: rpc.has_security_group_logging(os_id): False [ 1125.594582] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.594815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.594815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.595226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.595347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.595579] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.595686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.595753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.595954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.596059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.596293] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.596391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.596470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.596618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.596715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.596893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.596987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.597058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.597210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.597287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.597375] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1125.657814] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.658081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.658133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.658354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.658500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.673397] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1125.859180] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.362870] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54442a91-18b6-4b09-9577-94704b92215d: rpc.has_security_group_logging(os_id): False [ 1126.379695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.379932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.379932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.380127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.380288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.380468] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.380568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.380632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.380783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.380859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.380945] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be created. [ 1126.445234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.445234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.445234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.445234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.445234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.459552] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: IN_PROGRESS for 2s [ 1126.788997] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1126.789432] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1127.690717] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1127.690954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.471884] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1128.472523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.278579] env[68828]: INFO networking_nsxv3.common.synchronization [req-b7d4b77a-30af-41e9-8e39-007ba71e9469 req-99fe005d-0c75-465a-ba88-8bead485f7b7 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1131.278764] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1131.279344] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.279344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.279344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.279537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.279537] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.280389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.280556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.280817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.280974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.281271] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.654860] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.655174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.655339] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.655631] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.655957] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.656177] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.656303] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.656555] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.656725] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.656961] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.657106] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.657246] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.657362] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.657487] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.657607] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.657762] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.677554] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.677719] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1131.677905] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.678132] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.678452] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5728f6a9-d708-47e0-9883-fbf1b8c80563 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.678649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.678777] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.679213] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.679364] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5728f6a9-d708-47e0-9883-fbf1b8c80563',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.783340] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.783524] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.783583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.783807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.784049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.784134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.784234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.784294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.784443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.784526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.784596] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 already deleted. [ 1131.784673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.181544] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.181788] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.181920] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.182261] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.182426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.182590] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5728f6a9-d708-47e0-9883-fbf1b8c80563 not found, creating... [ 1132.182862] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.183069] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.183217] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.183429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.183572] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.183861] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.184032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.184159] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.184371] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.184510] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.184650] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5728f6a9-d708-47e0-9883-fbf1b8c80563 is going to be created. [ 1132.211232] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.211440] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.211567] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.211881] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.212139] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.212400] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.621011] env[68828]: INFO networking_nsxv3.common.synchronization [req-9e17cb07-ab35-4ca4-8fbb-fdadc5cbe578 req-0b403d58-0a0e-4cf6-bfa1-947a17b9befb tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1132.621600] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1132.621854] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.622115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.622115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.622255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.622394] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.622506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.622561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.622678] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.622757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.622841] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.125653] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.182905] env[68828]: INFO networking_nsxv3.common.synchronization [req-b7d4b77a-30af-41e9-8e39-007ba71e9469 req-b772ba79-7323-4de3-88f2-b67ebbd54da0 service nova] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_rules [ 1133.183088] env[68828]: INFO networking_nsxv3.common.synchronization [req-b7d4b77a-30af-41e9-8e39-007ba71e9469 req-b772ba79-7323-4de3-88f2-b67ebbd54da0 service nova] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1133.183230] env[68828]: INFO networking_nsxv3.common.synchronization [req-b7d4b77a-30af-41e9-8e39-007ba71e9469 req-b772ba79-7323-4de3-88f2-b67ebbd54da0 service nova] Enqueued Resource ID: 5728f6a9-d708-47e0-9883-fbf1b8c80563 with Priority: HIGHEST for action port [ 1133.183449] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_rules [ 1133.183568] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1133.183657] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5728f6a9-d708-47e0-9883-fbf1b8c80563 with Priority: HIGHEST for action port [ 1133.184218] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.184357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.186115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.186115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.186115] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.188828] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.188991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.189045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.189216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.189372] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.189468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.189525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.189668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.189749] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.190322] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.190638] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5728f6a9-d708-47e0-9883-fbf1b8c80563 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.190743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.190810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.190958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.191043] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5728f6a9-d708-47e0-9883-fbf1b8c80563',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.628015] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.694873] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.695089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.695249] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.696118] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5728f6a9-d708-47e0-9883-fbf1b8c80563 with status ACTIVE [ 1133.696311] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.699772] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.699772] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.699772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.699772] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5728f6a9-d708-47e0-9883-fbf1b8c80563 is going to be updated. [ 1133.719709] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.719867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.719923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.720142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.720276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.720424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5728f6a9-d708-47e0-9883-fbf1b8c80563" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.130474] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.131391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.131391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.131391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.131391] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.131391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1134.163034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.163895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.163895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.163895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.163895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.173802] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1134.200494] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.703817] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.704226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.704226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.704297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.704357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.704463] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be created. [ 1134.727354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.727564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.727613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.727805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.727956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.752307] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: UNINITIALIZED for 2s [ 1136.184221] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1136.184565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.762938] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: SUCCESS [ 1136.763085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.763272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.763533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.763733] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.763850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.763915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.764080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.764161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.764243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.764330] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.266849] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.267306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.267306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.267306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.267506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.267614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.267677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.267837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.267917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.268016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.268168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.268259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.268319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.268459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.268593] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.268681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.268740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.268876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.268945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.269037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.269124] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.771249] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8420bd-ff5b-46bf-9912-8f61665f7b94: rpc.has_security_group_logging(os_id): False [ 1137.792698] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.792961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.793038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.793243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.793334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.793585] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.793686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.793774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.793895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.793970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.794160] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.794251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.794423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.794475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.794508] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.794681] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.794758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.794826] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.794952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.795074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.795176] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be created. [ 1137.864357] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.864585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.864585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.864782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.864989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.878454] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: IN_PROGRESS for 2s [ 1138.184571] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.184699] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1139.893702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: SUCCESS [ 1139.894026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.145182] env[68828]: INFO networking_nsxv3.common.synchronization [req-a561a83b-e508-4904-a58c-1d72e393038e req-c19ca9f1-e4b7-40e6-8ec2-d7f79bbb8784 tempest-ServersTestJSON-1924623746 tempest-ServersTestJSON-1924623746-project-member] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1140.145719] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGHEST for action security_group_members [ 1140.146055] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.146195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.146266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.146461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.146618] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.146715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.146777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.146920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.147013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.147109] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.651053] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.651053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.651053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.651324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.651324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.651535] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.651638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.651700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.651856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.651934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.652031] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be updated. [ 1140.681057] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.681057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.681057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.681057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.681057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.688817] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 2s [ 1141.836736] env[68828]: INFO networking_nsxv3.common.synchronization [req-ab1fb2f9-4964-4f34-bfa7-cf4a20253a56 req-2fe383e8-51bc-46b5-84e3-803aea878025 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1141.837168] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1141.837488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.838463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.838502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.838682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.838846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.838956] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.839034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.839188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.839291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.839363] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.161295] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.161598] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.161832] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.162203] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.162606] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.162939] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.163059] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.163402] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.163641] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.164138] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.164138] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.164285] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.164453] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.164627] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.164796] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.164995] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.185720] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.185923] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1142.186082] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.186269] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.186591] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-710dc9c0-cc83-48a6-ac69-683c98754bb8 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.186766] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.186891] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.187241] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.187391] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710dc9c0-cc83-48a6-ac69-683c98754bb8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.342013] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.690970] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.691381] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.691738] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.692042] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.692216] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.692387] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 710dc9c0-cc83-48a6-ac69-683c98754bb8 not found, creating... [ 1142.692653] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.692825] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.692941] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.693222] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.693374] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.693663] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.693818] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.693939] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.694167] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.694310] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.694453] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 710dc9c0-cc83-48a6-ac69-683c98754bb8 is going to be created. [ 1142.702906] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: IN_PROGRESS for 4s [ 1142.716115] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.716115] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.716241] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.716452] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.716675] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.716892] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.844706] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.348069] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.348244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.348317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.348541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.348634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.348750] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be updated. [ 1143.379878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.380042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.380116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.380319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.380469] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.388852] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: IN_PROGRESS for 2s [ 1143.437463] env[68828]: INFO networking_nsxv3.common.synchronization [req-ab1fb2f9-4964-4f34-bfa7-cf4a20253a56 req-dd053787-3695-41ea-a30e-854a0ac4f132 service nova] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1143.438057] env[68828]: INFO networking_nsxv3.common.synchronization [req-ab1fb2f9-4964-4f34-bfa7-cf4a20253a56 req-dd053787-3695-41ea-a30e-854a0ac4f132 service nova] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1143.438273] env[68828]: INFO networking_nsxv3.common.synchronization [req-ab1fb2f9-4964-4f34-bfa7-cf4a20253a56 req-dd053787-3695-41ea-a30e-854a0ac4f132 service nova] Enqueued Resource ID: 710dc9c0-cc83-48a6-ac69-683c98754bb8 with Priority: HIGHEST for action port [ 1143.438530] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_rules [ 1143.438675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1143.438781] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710dc9c0-cc83-48a6-ac69-683c98754bb8 with Priority: HIGHEST for action port [ 1143.439377] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.439514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.440944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.440944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.440944] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.440944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.440944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.441319] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-710dc9c0-cc83-48a6-ac69-683c98754bb8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.441319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.441319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.441883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.441883] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710dc9c0-cc83-48a6-ac69-683c98754bb8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.945044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.945044] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 710dc9c0-cc83-48a6-ac69-683c98754bb8 with status ACTIVE [ 1143.945044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.945044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.945044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.945044] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.945963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.945963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.945963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.945963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.945963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 710dc9c0-cc83-48a6-ac69-683c98754bb8 is going to be updated. [ 1143.967425] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.967576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.967932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.967932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.967932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.968117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-710dc9c0-cc83-48a6-ac69-683c98754bb8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.329246] env[68828]: INFO networking_nsxv3.common.synchronization [req-947ee67b-57e7-4013-82c4-2207fd06cbfb req-87e3c769-042b-4af3-8755-959333d547f1 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1144.329321] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1144.331032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.331032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.331032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.331032] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.713188] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37ec0117-a289-428f-9466-58f2541a90c7 in Status: SUCCESS [ 1144.713354] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 deletion is rescheduled due to dependency. [ 1144.713492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.833517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.833714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.833762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.833967] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.834080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.834320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.834380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.834494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.834585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.834677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.834744] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1144.859809] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.860034] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.860148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.860336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.860482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.869850] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1145.398149] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1145.398503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.398503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.400088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.400088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.400088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.400088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.400088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.400088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.400088] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.901912] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.409938] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.885424] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1146.885424] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1146.885424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.914652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.914652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.914652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.914652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.914652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.914652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be updated. [ 1146.953520] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.953520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.953520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.953520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.953520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.960718] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: IN_PROGRESS for 2s [ 1147.906568] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.906944] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.906944] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.907190] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.907460] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.908437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.908437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.908437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.908437] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.908767] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.908767] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.908857] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.908998] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.909164] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.909309] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.909476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.927133] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.927333] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.927476] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.927656] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.927973] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-f95ade32-ced6-4c6f-a502-11af5518764f taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.928168] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.928295] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.928573] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.928716] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95ade32-ced6-4c6f-a502-11af5518764f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.431173] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.431433] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.431566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.431858] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.432034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.432340] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.432504] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.432628] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.432849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.432989] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.433308] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.433471] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.433593] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.433801] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.433938] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.434096] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: f95ade32-ced6-4c6f-a502-11af5518764f is going to be updated. [ 1148.456534] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.456749] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.456907] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.457213] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.457491] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.457840] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.975478] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1148.975825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.975866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.976099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.976325] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.976446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.976511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.976669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.976752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.976839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.976926] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.330727] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1149.330832] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1149.422738] env[68828]: INFO networking_nsxv3.common.synchronization [req-f2a90aa3-f164-489b-9a6e-e02d38292fc3 req-8356111c-88f6-4594-bdaa-57250cd0dce9 service nova] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1149.423076] env[68828]: INFO networking_nsxv3.common.synchronization [req-f2a90aa3-f164-489b-9a6e-e02d38292fc3 req-8356111c-88f6-4594-bdaa-57250cd0dce9 service nova] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1149.423311] env[68828]: INFO networking_nsxv3.common.synchronization [req-f2a90aa3-f164-489b-9a6e-e02d38292fc3 req-8356111c-88f6-4594-bdaa-57250cd0dce9 service nova] Enqueued Resource ID: f95ade32-ced6-4c6f-a502-11af5518764f with Priority: HIGHEST for action port [ 1149.423598] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_rules [ 1149.423680] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1149.423775] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f95ade32-ced6-4c6f-a502-11af5518764f with Priority: HIGHEST for action port [ 1149.424708] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.424843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.424912] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.425206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.425305] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.426246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.426402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.426446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.426578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.426732] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.426834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.426894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.427066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.427157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.427244] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.428157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f95ade32-ced6-4c6f-a502-11af5518764f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.428289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.428355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.428504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.428577] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95ade32-ced6-4c6f-a502-11af5518764f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.479529] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.930123] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.931161] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.931277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.934069] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f95ade32-ced6-4c6f-a502-11af5518764f with status ACTIVE [ 1149.934218] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.934333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.934398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.934605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.934718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.935222] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.935222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.935222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.935222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.935395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.935424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.935797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.935797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.935887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.935917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.936008] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f95ade32-ced6-4c6f-a502-11af5518764f is going to be updated. [ 1149.955047] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.955237] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.955303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.955475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.955635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.955815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f95ade32-ced6-4c6f-a502-11af5518764f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.981199] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54442a91-18b6-4b09-9577-94704b92215d: rpc.has_security_group_logging(os_id): False [ 1149.999062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.999207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.999309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.999571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.999670] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.000456] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.000456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.000456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.000456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.000456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.001262] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be updated. [ 1150.086226] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.086448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.086574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.086818] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.086971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.103116] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: IN_PROGRESS for 2s [ 1150.432806] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.936142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.936363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.936422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.936631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.936734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.936829] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea is going to be updated. [ 1150.970200] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.970343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.970416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.970638] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.970781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.981014] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: IN_PROGRESS for 2s [ 1151.431036] env[68828]: INFO networking_nsxv3.common.synchronization [None req-0c941561-cbaa-4762-9394-1cfd15173eb6 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1151.431749] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1151.432132] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.432276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.432339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.432575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.432754] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.432870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.432980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.433149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.433262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.433370] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.936574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.936716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.936757] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.936977] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.937086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.937282] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.937382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.937445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.937662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.937741] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.937830] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1151.973449] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.973585] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.973674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.973847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.973983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.984480] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1152.132919] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1152.133163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.018056] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: SUCCESS [ 1153.018382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.018496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.018665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.018868] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.018990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.019070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.019222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.019330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.019445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.019603] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.521300] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.855175] env[68828]: INFO networking_nsxv3.common.synchronization [req-3e196ba6-3dae-4324-8e34-2e9aa7198a49 req-995073f9-0b67-4456-bb64-40624294ec57 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1153.855175] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1153.855175] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.855175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.855175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.855175] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.855418] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.855486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.855559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.855728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.855813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.855908] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.995419] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1153.995635] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 deletion is rescheduled due to dependency. [ 1153.995771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.023729] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c1aa990-7ca3-4056-913b-d8a56e8959ea: rpc.has_security_group_logging(os_id): False [ 1154.052156] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.052156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.052156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.052489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.052770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.053072] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.053249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.053364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.053639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.053758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.053955] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea is going to be updated. [ 1154.134643] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.134643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.134643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.134643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.134643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.147964] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: IN_PROGRESS for 2s [ 1154.153614] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.154638] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.154638] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.154638] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.154793] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.154952] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.155125] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.155455] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.155621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.155839] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1154.155977] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.156108] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.156237] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.156364] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1154.156478] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.156616] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.179106] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.179106] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1154.179106] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.179348] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.179843] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-1e5986e5-b282-4a95-b5a8-6386255882e6 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.181157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.181157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.181157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.181157] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5986e5-b282-4a95-b5a8-6386255882e6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.358040] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.358248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.358328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.358568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.358659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.358864] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.358960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.359035] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.359187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.359262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.359351] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1154.383783] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.384048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.384048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.384218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.384363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.393877] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1154.684050] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.684454] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.684713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.685192] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.685484] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.685781] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 1e5986e5-b282-4a95-b5a8-6386255882e6 not found, creating... [ 1154.686244] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.686540] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.686802] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.687200] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.687470] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.687969] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.688267] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.688533] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.688894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.689157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.689437] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 1e5986e5-b282-4a95-b5a8-6386255882e6 is going to be created. [ 1154.709849] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.709849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.709849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.709849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.710219] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.710861] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.378874] env[68828]: INFO networking_nsxv3.common.synchronization [req-3e196ba6-3dae-4324-8e34-2e9aa7198a49 req-494d59c2-4c00-45a8-9cbf-2764e5cb4756 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1155.379162] env[68828]: INFO networking_nsxv3.common.synchronization [req-3e196ba6-3dae-4324-8e34-2e9aa7198a49 req-494d59c2-4c00-45a8-9cbf-2764e5cb4756 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1155.379162] env[68828]: INFO networking_nsxv3.common.synchronization [req-3e196ba6-3dae-4324-8e34-2e9aa7198a49 req-494d59c2-4c00-45a8-9cbf-2764e5cb4756 service nova] Enqueued Resource ID: 1e5986e5-b282-4a95-b5a8-6386255882e6 with Priority: HIGHEST for action port [ 1155.379424] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1155.379521] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1155.379576] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5986e5-b282-4a95-b5a8-6386255882e6 with Priority: HIGHEST for action port [ 1155.380471] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.380471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.380471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.380471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.380799] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.381346] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.381712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.381712] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e5986e5-b282-4a95-b5a8-6386255882e6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.381712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.381906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.381947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.382054] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5986e5-b282-4a95-b5a8-6386255882e6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.883881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.883881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.890022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e5986e5-b282-4a95-b5a8-6386255882e6 with status ACTIVE [ 1155.890022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.890022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.890022] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.890022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.890022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e5986e5-b282-4a95-b5a8-6386255882e6 is going to be updated. [ 1155.911905] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.911905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.912097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.912183] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.912307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.912459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e5986e5-b282-4a95-b5a8-6386255882e6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.161590] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: SUCCESS [ 1156.161815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.412085] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1156.412521] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1156.412561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.412918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.413289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.413600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.413788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.413916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.414572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.414572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.414572] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.916546] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.419216] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.922210] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.922210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.922210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.922424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.923766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.923766] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1157.963730] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.963864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.963932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.964169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.964307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.973934] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1158.430728] env[68828]: INFO networking_nsxv3.common.synchronization [req-c7a84981-e923-4148-8be4-ec8a925d7a23 req-839a48c3-c8d9-45b8-8c61-ceb79f4df725 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_members [ 1158.431462] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGHEST for action security_group_members [ 1158.431462] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.431615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.431615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.431815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.431962] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.432222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.432330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.432527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.432661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.432849] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.935020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.935234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.935386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.935645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.935766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.935998] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.936119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.936186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.936347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.936438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.936503] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a is going to be updated. [ 1158.964689] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.964861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.964900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.965087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.965223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.973547] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a in Status: IN_PROGRESS for 2s [ 1159.988678] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1159.989076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.989076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.989298] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.989493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.989611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.989703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.989874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.989959] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.990058] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.990153] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.494043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.494043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.494043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.494043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.494043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.495100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.495100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.495100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.495100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.495100] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.984846] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a in Status: SUCCESS [ 1160.985058] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a deletion is rescheduled due to dependency. [ 1160.985182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.995717] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25c2ea4d-ec48-482b-ad32-9b9a12f4793a: rpc.has_security_group_logging(os_id): False [ 1161.015149] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.015373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.015373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.015700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.015846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.016084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.016187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.016254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.016946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.016946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.016946] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.016946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.017223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.017223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.017289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.017450] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.017619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.017733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.017913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.017995] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.018105] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1161.078077] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.078077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.078077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.078387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.078387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.093962] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1161.760882] env[68828]: INFO networking_nsxv3.common.synchronization [req-90d8e333-d833-4039-8bd0-7cf95e71d1c1 req-e7f1ab45-0f86-4b31-bc58-3494ff03926f tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1161.761424] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1161.761738] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.761866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.761929] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.762433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.762646] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.762905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.762905] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.763038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.763118] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.764048] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.266231] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.266504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.266554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.266821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.266950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.267214] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.267325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.267389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.267546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.267624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.267735] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be updated. [ 1162.316171] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.316310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.316376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.316634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.316788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.325062] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: IN_PROGRESS for 2s [ 1163.121702] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1163.121702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.443388] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a2f1a56d-448b-4ee0-bf4a-62b2bf62902a tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_rules [ 1163.443938] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_rules [ 1163.444265] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.444387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.444443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.444729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.444817] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.510612] env[68828]: INFO networking_nsxv3.common.synchronization [None req-6ba55749-339e-425e-900c-4dc86e4f91c4 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_rules [ 1163.511151] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_rules [ 1163.511484] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.511843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.966662] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.966806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.966878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.967115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.967204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.967303] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a771ab20-d012-4cc4-a555-22b26893f658 already deleted. [ 1163.967389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.967525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.967696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.967769] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.333870] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: SUCCESS [ 1164.334043] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 deletion is rescheduled due to dependency. [ 1164.334230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.487212] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.487212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.487212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.487548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.487548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.487664] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a771ab20-d012-4cc4-a555-22b26893f658 already deleted. [ 1164.487697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.676759] env[68828]: INFO networking_nsxv3.common.synchronization [None req-eb244253-25f7-4880-88f9-7fc82ee8ad8d tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_rules [ 1166.677332] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_rules [ 1166.678032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.678032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.678032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.678215] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.678215] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.765952] env[68828]: INFO networking_nsxv3.common.synchronization [None req-92a8e259-0d64-4d6a-a2af-89993edab4e7 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_rules [ 1166.766461] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_rules [ 1166.767020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.767020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.199875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.200201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.200307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.200896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.200896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.200896] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 already deleted. [ 1167.201145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.201145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.201354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.201435] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.720561] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.720984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.720984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.720984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.721102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.721177] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 already deleted. [ 1167.721259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.776938] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.777287] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.777287] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.777542] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.777796] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.777953] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.778085] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.778302] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.778454] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.778664] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.778780] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.778892] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.779014] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.779132] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.779287] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.779377] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.798520] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.798690] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1168.798828] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.798991] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.799283] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-9c962281-ad94-4999-9e90-a308ceeaec6a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.799484] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.799569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.799865] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.800013] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c962281-ad94-4999-9e90-a308ceeaec6a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.862783] env[68828]: INFO networking_nsxv3.common.synchronization [req-47aa0ef6-f580-4c1b-b566-fa4e09e88542 req-73c413bd-2d65-4990-bd96-4f6f3a2d7e53 tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_members [ 1168.863267] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_members [ 1168.863640] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.863879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.863953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.864211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.864368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.864466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.864530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.864679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.864763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.864855] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.156992] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.157250] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.157440] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.157696] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.157959] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.158128] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.158271] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.158523] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.158695] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.158953] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.159101] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.159236] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.159377] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.159542] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.159687] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.159978] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.176774] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.176982] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1169.177166] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.177390] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-230" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.177767] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.177954] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.178114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.178455] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.178622] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.277230] env[68828]: INFO networking_nsxv3.common.synchronization [req-7d315009-d8fc-4311-9b52-8264ef80a14a req-dfaea6a1-c499-4e7c-b3e0-2d6e4bbb5a99 tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1169.277742] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1169.278089] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.278216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.278285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.278963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.278963] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.278963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.278963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.278963] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.279216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.279216] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.302119] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.302292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.302394] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.302673] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.302829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.302996] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 9c962281-ad94-4999-9e90-a308ceeaec6a not found, creating... [ 1169.303298] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.303491] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.303614] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.303844] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.304093] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.304282] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.304485] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.304617] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.304837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.304976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.305140] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 9c962281-ad94-4999-9e90-a308ceeaec6a is going to be created. [ 1169.324810] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.324810] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.324994] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.325178] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.325416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.325728] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.367342] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.367560] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.367660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.367946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.368083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.368405] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.368542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.368610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.368806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.368934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.369055] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a771ab20-d012-4cc4-a555-22b26893f658 already deleted. [ 1169.369150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.681333] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.681562] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.681696] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.682628] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.682845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.683033] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 not found, creating... [ 1169.683319] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.683586] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.683668] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.683898] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.684122] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.684448] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.684619] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.684745] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.684962] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.685121] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.685303] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 is going to be created. [ 1169.703652] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.703867] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.704030] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.704240] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.704464] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.704713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.781504] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.781796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.781796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.781962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.782077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.782285] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.782393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.782450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.782605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.782682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.782770] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1169.811831] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.811990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.812073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.812294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.812438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.824417] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1169.998314] env[68828]: INFO networking_nsxv3.common.synchronization [req-16868a41-95d9-4b09-8cf8-45a733fcef3b req-06c7e7b8-03fa-4f73-8614-127a1e4a2c51 service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1169.998314] env[68828]: INFO networking_nsxv3.common.synchronization [req-16868a41-95d9-4b09-8cf8-45a733fcef3b req-06c7e7b8-03fa-4f73-8614-127a1e4a2c51 service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1169.998314] env[68828]: INFO networking_nsxv3.common.synchronization [req-16868a41-95d9-4b09-8cf8-45a733fcef3b req-06c7e7b8-03fa-4f73-8614-127a1e4a2c51 service nova] Enqueued Resource ID: 9c962281-ad94-4999-9e90-a308ceeaec6a with Priority: HIGHEST for action port [ 1169.998314] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1169.998314] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1169.998314] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c962281-ad94-4999-9e90-a308ceeaec6a with Priority: HIGHEST for action port [ 1169.998314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.998314] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.998314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.998314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.998314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.999432] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.999432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c962281-ad94-4999-9e90-a308ceeaec6a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.999432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.999432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.999432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.999432] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c962281-ad94-4999-9e90-a308ceeaec6a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.397908] env[68828]: INFO networking_nsxv3.common.synchronization [req-47aa0ef6-f580-4c1b-b566-fa4e09e88542 req-4885f89f-ec7c-46af-b972-7e1d97ea6c8a service nova] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_rules [ 1170.398114] env[68828]: INFO networking_nsxv3.common.synchronization [req-47aa0ef6-f580-4c1b-b566-fa4e09e88542 req-4885f89f-ec7c-46af-b972-7e1d97ea6c8a service nova] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_members [ 1170.398265] env[68828]: INFO networking_nsxv3.common.synchronization [req-47aa0ef6-f580-4c1b-b566-fa4e09e88542 req-4885f89f-ec7c-46af-b972-7e1d97ea6c8a service nova] Enqueued Resource ID: 7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 with Priority: HIGHEST for action port [ 1170.398487] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_rules [ 1170.398675] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_members [ 1170.398711] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 with Priority: HIGHEST for action port [ 1170.399294] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.399443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.399480] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.399716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.399801] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.400672] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.400788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.400856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.401033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.401179] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.401273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.401334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.401470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.401554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.401642] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.402635] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.402727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.402800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.402954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.403041] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.501274] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.501274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.502777] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.504217] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c962281-ad94-4999-9e90-a308ceeaec6a with status ACTIVE [ 1170.504401] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.504557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.504635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.504907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.505018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.505222] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.505328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.505394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.505575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.505656] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.505840] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.505936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.505992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.506270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.506351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.506457] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c962281-ad94-4999-9e90-a308ceeaec6a is going to be updated. [ 1170.526719] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.526936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.526936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.527171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.527307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.527471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.655034] env[68828]: INFO networking_nsxv3.common.synchronization [req-667dec2f-02da-4c34-88ee-26ab2571e919 req-c1f5c47b-4b2c-48bd-8d6b-52525f7892e0 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1170.655284] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1170.656032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.656032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.656032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.656243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.656243] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.656393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.656492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.656761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.656855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.657246] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.905517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.905781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.905907] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.906831] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 with status ACTIVE [ 1170.907462] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.908283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.908283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.908283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.908283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.908519] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.908519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.908519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.908661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.908766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.908965] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.909077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.909200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.909329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.909399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.909492] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9 is going to be updated. [ 1170.934141] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.934368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.934368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.934549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.934681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.934832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a3aa8f3-697f-4d0b-8a0b-80317a0cd7b9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.008725] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.160724] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.160965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.161042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.161364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.161489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.161788] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.161991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.162069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.162243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.162351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.162479] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1171.194746] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.194985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.194985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.195163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.195304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.205033] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1171.412058] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.513602] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.513602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.513602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.513602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.513602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.513602] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1171.540269] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.540485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.540567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.540887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.541130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.549713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1171.834394] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1171.834604] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd deletion is rescheduled due to dependency. [ 1171.834770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.913488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.913789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.913789] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.914511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.914511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.914511] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a771ab20-d012-4cc4-a555-22b26893f658 is going to be created. [ 1171.935694] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.935847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.935920] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.936161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.936500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.945144] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a771ab20-d012-4cc4-a555-22b26893f658 in Status: UNINITIALIZED for 2s [ 1172.141967] env[68828]: INFO networking_nsxv3.common.synchronization [req-56f1b024-d79b-4c54-8a49-3a97d90f08fc req-6f6d0c3d-47d5-4848-8fa9-b7b7c562580e tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_members [ 1172.142694] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_members [ 1172.143157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.143345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.143455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.143821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.144104] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.144276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.144398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.144659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.144897] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.144954] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.456747] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.456952] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.457101] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.457392] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.457671] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.457866] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.457996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.458239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.458394] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.458614] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.458735] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.458852] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.458982] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.459106] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.459226] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.459372] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.478863] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.479206] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.479371] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.479566] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.479889] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-72e363e1-d321-4080-bd74-b9509a853fe6 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.480081] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.480210] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.480549] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.480695] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72e363e1-d321-4080-bd74-b9509a853fe6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.647616] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.647782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.647872] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.648081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.648180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.648383] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.648484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.648811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.648811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.648811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.648972] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 already deleted. [ 1172.648972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.983115] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.983459] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.983521] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.983866] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.984045] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.984212] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 72e363e1-d321-4080-bd74-b9509a853fe6 not found, creating... [ 1172.984479] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.984646] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.984770] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.985015] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.985228] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.985542] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.985711] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.985835] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.986143] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.986405] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.986476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 72e363e1-d321-4080-bd74-b9509a853fe6 is going to be created. [ 1173.005115] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.005374] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.005574] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.005839] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.006081] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.006327] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.214341] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1173.214537] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1173.214627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.559047] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1173.559361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.559674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.560064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.560375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.560599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.560722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.560973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.561177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.561371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.561673] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.681231] env[68828]: INFO networking_nsxv3.common.synchronization [req-56f1b024-d79b-4c54-8a49-3a97d90f08fc req-6388498e-3500-41db-a75a-19d0f0f9b4ea service nova] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_rules [ 1173.681231] env[68828]: INFO networking_nsxv3.common.synchronization [req-56f1b024-d79b-4c54-8a49-3a97d90f08fc req-6388498e-3500-41db-a75a-19d0f0f9b4ea service nova] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_members [ 1173.681231] env[68828]: INFO networking_nsxv3.common.synchronization [req-56f1b024-d79b-4c54-8a49-3a97d90f08fc req-6388498e-3500-41db-a75a-19d0f0f9b4ea service nova] Enqueued Resource ID: 72e363e1-d321-4080-bd74-b9509a853fe6 with Priority: HIGHEST for action port [ 1173.681231] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_rules [ 1173.681231] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_members [ 1173.681231] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72e363e1-d321-4080-bd74-b9509a853fe6 with Priority: HIGHEST for action port [ 1173.681795] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.682065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.682712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.682712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.682712] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.683460] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.683618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.683707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.683931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.684141] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.684272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.684366] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.684547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.684658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.684771] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.685549] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-72e363e1-d321-4080-bd74-b9509a853fe6 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.687222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.687222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.687222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.687222] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72e363e1-d321-4080-bd74-b9509a853fe6',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.954939] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a771ab20-d012-4cc4-a555-22b26893f658 in Status: SUCCESS [ 1173.955198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.955352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.955653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.955858] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.955980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.956057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.956213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.956294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.956383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.956524] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.064972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.065370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.065370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.065464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.065706] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.065809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.065873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.066032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.066120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.066207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.066356] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.066449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.066509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.066816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.066873] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.066973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.067048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.067191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.067269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.067349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.067434] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.187628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.187800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.187973] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.188861] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72e363e1-d321-4080-bd74-b9509a853fe6 with status ACTIVE [ 1174.189952] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.189952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.189952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.190153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.190153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.190349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.190462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.190499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.190628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.190704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.190885] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.190974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.191241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.191341] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.191430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.191506] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72e363e1-d321-4080-bd74-b9509a853fe6 is going to be updated. [ 1174.210207] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.210343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.210416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.210655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.210844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.211019] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72e363e1-d321-4080-bd74-b9509a853fe6" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.461102] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.570080] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f4a4187-5566-42ed-af79-13c7cf7b4577: rpc.has_security_group_logging(os_id): False [ 1174.591371] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.591590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.591658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.591917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.592127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.592320] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.592433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.592526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.592707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.592792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.593052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.593159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.593227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.593409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.593503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.593725] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.593833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.593894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.594077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.594172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.594260] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1174.649241] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.649241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.649459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.649496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.649722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.664237] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1174.693834] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.964637] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a771ab20-d012-4cc4-a555-22b26893f658: rpc.has_security_group_logging(os_id): False [ 1174.981194] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.981344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.981417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.981633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.981728] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.982015] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.982133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.982197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.982355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.982433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.982522] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a771ab20-d012-4cc4-a555-22b26893f658 is going to be created. [ 1175.044915] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.045124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.045124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.045345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.045588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.057354] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a771ab20-d012-4cc4-a555-22b26893f658 in Status: IN_PROGRESS for 2s [ 1175.196598] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.197106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.197106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.197106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.197106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.197227] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 is going to be created. [ 1175.222358] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.222507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.222581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.222786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.222986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.233785] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 in Status: UNINITIALIZED for 2s [ 1176.677969] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1176.678371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.068308] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a771ab20-d012-4cc4-a555-22b26893f658 in Status: SUCCESS [ 1177.068521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.243152] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 in Status: SUCCESS [ 1177.243410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.243602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.243823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.244039] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.244218] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.244316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.244486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.244578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.244672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.244760] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.455301] env[68828]: INFO networking_nsxv3.common.synchronization [req-c8e9535c-0eb8-4157-af01-df2aed6982d5 req-149800a8-545b-4e59-a6e2-f04c16960bde tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1177.455301] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1177.455301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.455658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.455658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.455832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.456037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.457138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.457249] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.457445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.457624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.457873] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.747050] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.758073] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.758298] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.758429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.758710] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.758982] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.759158] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.759705] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.759958] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.760135] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.760359] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.760482] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.760601] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.760720] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.760836] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.760948] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.761114] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.780589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.780838] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.781034] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.781280] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.781618] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.781842] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.782020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.782373] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.782574] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d637e1-32dd-4bb6-a157-b4ce6f25d6e2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.962017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.962208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.962282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.962497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.962592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.962796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.962889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.962954] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.963123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.963200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.963288] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1177.985526] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.985837] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.985926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.986158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.986307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.994321] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1178.252986] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ccb4815-10bb-46a0-9b26-0a53fb6c8347: rpc.has_security_group_logging(os_id): False [ 1178.269708] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.269961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.270066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.270278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.270374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.270619] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.270733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.270838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.271073] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.271169] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.271260] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 is going to be created. [ 1178.284749] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.284953] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.285096] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.285354] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.285503] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.285713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 not found, creating... [ 1178.285969] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.286147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.286272] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.286491] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.286683] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.286965] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.287146] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.287270] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.287485] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.287636] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.287774] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 is going to be created. [ 1178.312678] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.312868] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.313010] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.313271] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.313501] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.313740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.332709] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.332882] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.332928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.333107] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.333274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.357932] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 in Status: IN_PROGRESS for 2s [ 1179.221364] env[68828]: INFO networking_nsxv3.common.synchronization [req-c8e9535c-0eb8-4157-af01-df2aed6982d5 req-b924b422-f6c3-47c3-8c60-9d47d2ed5f59 service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1179.221628] env[68828]: INFO networking_nsxv3.common.synchronization [req-c8e9535c-0eb8-4157-af01-df2aed6982d5 req-b924b422-f6c3-47c3-8c60-9d47d2ed5f59 service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1179.221730] env[68828]: INFO networking_nsxv3.common.synchronization [req-c8e9535c-0eb8-4157-af01-df2aed6982d5 req-b924b422-f6c3-47c3-8c60-9d47d2ed5f59 service nova] Enqueued Resource ID: 32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 with Priority: HIGHEST for action port [ 1179.221953] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1179.222116] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1179.222215] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 with Priority: HIGHEST for action port [ 1179.222757] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.222886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.222955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.224013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.224112] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.225353] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.225461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.225688] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.225802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.225862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.226055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.226186] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d637e1-32dd-4bb6-a157-b4ce6f25d6e2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.725917] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.726170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.728492] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 with status ACTIVE [ 1179.728695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.728827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.728898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.729136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.729432] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.729533] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.729595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.729791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.729982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.730208] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.730310] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.730375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.730525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.730602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.730692] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32d637e1-32dd-4bb6-a157-b4ce6f25d6e2 is going to be updated. [ 1179.749055] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.749193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.749263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.749399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.749681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.749681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32d637e1-32dd-4bb6-a157-b4ce6f25d6e2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.918183] env[68828]: INFO networking_nsxv3.common.synchronization [req-c5e1cf79-0272-4a80-ace9-b9bc0743649f req-8b86ba54-e455-498a-a7e6-221c44282734 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1179.919019] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1179.919019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.919162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.919213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.919406] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.919564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.919661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.919723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.919859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.919934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.920827] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.003100] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1180.003275] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd deletion is rescheduled due to dependency. [ 1180.003362] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.003511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.003721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.003898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.004024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.004085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.004248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.004396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.004486] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.205439] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.205708] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.205867] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.206169] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.206670] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.206837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.206983] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.207232] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.207387] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.207600] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.207717] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.207827] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.207965] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.208116] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.208227] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.208362] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.226443] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.226788] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.226788] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.226944] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.227335] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-8b33585b-1a13-4111-88be-498a6e129508 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.227416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.227532] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.227840] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.227993] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b33585b-1a13-4111-88be-498a6e129508',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.368469] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 in Status: SUCCESS [ 1180.368703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.422742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.422962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.423076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.423330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.423447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.423696] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.423820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.423888] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.424101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.424191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.424300] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1180.448163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.448337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.448381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.448540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.448793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.458904] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1180.506426] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.729701] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.730025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.730167] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.730446] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.730602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.730775] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 8b33585b-1a13-4111-88be-498a6e129508 not found, creating... [ 1180.731084] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.731297] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.731422] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.731653] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.731805] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.732126] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.732323] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.732488] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.732711] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.732859] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.732999] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 8b33585b-1a13-4111-88be-498a6e129508 is going to be created. [ 1180.762131] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.762383] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.762619] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.762770] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.763016] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.763348] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.008378] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.427603] env[68828]: INFO networking_nsxv3.common.synchronization [req-c5e1cf79-0272-4a80-ace9-b9bc0743649f req-5862d497-e9ef-4ed5-aa48-72520b6afd40 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1181.427603] env[68828]: INFO networking_nsxv3.common.synchronization [req-c5e1cf79-0272-4a80-ace9-b9bc0743649f req-5862d497-e9ef-4ed5-aa48-72520b6afd40 service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1181.427603] env[68828]: INFO networking_nsxv3.common.synchronization [req-c5e1cf79-0272-4a80-ace9-b9bc0743649f req-5862d497-e9ef-4ed5-aa48-72520b6afd40 service nova] Enqueued Resource ID: 8b33585b-1a13-4111-88be-498a6e129508 with Priority: HIGHEST for action port [ 1181.428071] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1181.428130] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1181.428240] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b33585b-1a13-4111-88be-498a6e129508 with Priority: HIGHEST for action port [ 1181.428548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.428695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.428784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.429018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.429124] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.430776] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.430776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.430776] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b33585b-1a13-4111-88be-498a6e129508 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.430776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.430776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.430776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.431154] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b33585b-1a13-4111-88be-498a6e129508',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.512083] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.512267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.512329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.513797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.513797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.513797] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1181.541499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.541679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.541721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.541919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.542084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.552593] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1181.932739] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.932886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.933110] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b33585b-1a13-4111-88be-498a6e129508 with status ACTIVE [ 1181.933287] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.933396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.933452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.933718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.933813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.933992] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.934103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.934163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.934323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.934398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.934575] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.934665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.934725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.934860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.934931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.935022] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b33585b-1a13-4111-88be-498a6e129508 is going to be updated. [ 1181.954493] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.954673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.954820] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.955095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.955177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.955665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b33585b-1a13-4111-88be-498a6e129508" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.468132] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1182.468470] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1182.468470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.468619] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.469130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.469333] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.469456] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.469526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.469704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.469793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.469890] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.972779] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.474715] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.562717] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1183.562950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.563141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.563354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.563562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.563698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.563746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.563902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.564007] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.564105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.564196] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.977735] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.977915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.977958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.978530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.978530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.978530] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1184.007182] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.007308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.007650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.007650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.007748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.016425] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1184.066362] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.568250] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27a4adfb-8bb8-4644-a926-1d5f3c8693cd: rpc.has_security_group_logging(os_id): False [ 1184.584826] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.585028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.585075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.585273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.585365] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.585629] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.585751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.585812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.585970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.586064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.586154] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1184.641326] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.641527] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.641571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.641781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.641924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.653182] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1185.797452] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.797795] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.797837] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.798147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.798450] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.798643] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.798774] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.799117] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.799212] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.799448] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.799601] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.799749] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.799864] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.799984] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.800118] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.800290] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.819675] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.819956] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1185.820101] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.820343] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-801" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.820700] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-9c962281-ad94-4999-9e90-a308ceeaec6a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.820927] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.821074] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.821452] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.821597] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c962281-ad94-4999-9e90-a308ceeaec6a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.026064] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1186.026317] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.026454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.026674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.026863] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.026984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.027071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.027202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.027275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.027364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.027449] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.324470] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.324776] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.324949] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.326108] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.326108] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.326108] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.326108] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.326295] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.326471] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.326615] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.326940] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.327115] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.327239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.327450] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.327588] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.327749] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 9c962281-ad94-4999-9e90-a308ceeaec6a is going to be updated. [ 1186.347239] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.347442] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.347588] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.347784] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.348020] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.348210] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.428922] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1186.429167] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1186.529891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.530117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.530117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.530332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.530513] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.530612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.530679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.530827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.530914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.531015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.531181] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.531277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.531340] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.531479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.531624] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.531716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.531778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.531915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.531988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.532084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.532170] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.682175] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1186.682308] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.034147] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25c2ea4d-ec48-482b-ad32-9b9a12f4793a: rpc.has_security_group_logging(os_id): False [ 1187.040903] env[68828]: INFO networking_nsxv3.common.synchronization [req-4852d270-0f9f-4372-8448-51d91f8608c7 req-225d1651-42ef-408d-9deb-5665da74ee4a service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1187.041015] env[68828]: INFO networking_nsxv3.common.synchronization [req-4852d270-0f9f-4372-8448-51d91f8608c7 req-225d1651-42ef-408d-9deb-5665da74ee4a service nova] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1187.041429] env[68828]: INFO networking_nsxv3.common.synchronization [req-4852d270-0f9f-4372-8448-51d91f8608c7 req-225d1651-42ef-408d-9deb-5665da74ee4a service nova] Enqueued Resource ID: 9c962281-ad94-4999-9e90-a308ceeaec6a with Priority: HIGHEST for action port [ 1187.041429] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_rules [ 1187.041429] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1187.041614] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c962281-ad94-4999-9e90-a308ceeaec6a with Priority: HIGHEST for action port [ 1187.042077] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.042208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.042302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.042466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.042545] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.043347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.043457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.043525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.043709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.043854] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.043949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.044022] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.044163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.044245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.044331] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.045037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c962281-ad94-4999-9e90-a308ceeaec6a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.045147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.045225] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.045497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.045497] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c962281-ad94-4999-9e90-a308ceeaec6a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.050894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.051043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.051164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.051286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.051375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.051572] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.051743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.051743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.051864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.051926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.052189] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.052482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.052482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.052482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.052482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.052626] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.052765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.052765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.052896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.053144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.053144] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1187.122187] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.122386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.122429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.122695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.122879] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.151830] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1187.548156] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.549157] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.549267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.549427] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c962281-ad94-4999-9e90-a308ceeaec6a with status ACTIVE [ 1187.549586] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.549692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.549772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.549982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.550084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.550251] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.550345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.550402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.550552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.550631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.550808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.550902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.550964] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.551134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.551210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.551326] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c962281-ad94-4999-9e90-a308ceeaec6a is going to be updated. [ 1187.573532] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.573640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.573714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.573910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.574055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.574224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c962281-ad94-4999-9e90-a308ceeaec6a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.053843] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.556206] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.556404] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.556448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.556758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.556900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.556981] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1188.581347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.581612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.581612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.581770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.581910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.589927] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1189.169922] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1189.169922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.600391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1190.600735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.600735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.600915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.601123] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.601238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.601299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.601465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.601545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.601633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.601723] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.104178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.104376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.104422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.104626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.104800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.104902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.104965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.105128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.105216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.105302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.105445] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.105535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.105594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.105755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.105902] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.105992] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.106082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.106266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.106345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.106451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.106503] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.608752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f4a4187-5566-42ed-af79-13c7cf7b4577: rpc.has_security_group_logging(os_id): False [ 1191.633702] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.633894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.633968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.634200] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.634295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.634513] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.634633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.634699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.634867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.634957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.635174] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.635284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.635345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.635487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.635563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.635797] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.635924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.635966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.636124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.636199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.636298] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1191.712303] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.712501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.712501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.712719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.712942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.727633] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1192.042494] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.042627] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1193.743717] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1193.744112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.970376] env[68828]: INFO networking_nsxv3.common.synchronization [req-be178f80-b02c-4541-9b74-61b60de79c3f req-2ec920a9-e598-41fa-9cd7-57e4fb57188b tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1194.970695] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1194.971039] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.971172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.971239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.971439] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.971600] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.971701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.971762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.971903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.971988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.972097] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.474349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.474621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.474621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.474793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.474885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.475102] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.475211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.475277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.475422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.475498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.475584] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1195.503883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.504068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.504124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.504307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.504440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.512601] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1197.523284] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1197.523621] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1197.523621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.971577] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1199.971880] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1202.489747] env[68828]: INFO networking_nsxv3.common.synchronization [req-b54ebcac-e59e-4611-b668-38873721d74a req-eadf9a89-a277-42e4-8dc5-c3ecf8a1574d tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1202.489747] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1202.490167] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.490762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.490762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.490762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.490762] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.490762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.490762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.491087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.491087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.491087] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.993346] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.472098] env[68828]: INFO networking_nsxv3.common.synchronization [req-7aafab82-ae77-4f63-9ebc-08f269cc39b7 req-a62cbcd0-680a-439d-983a-164f8c3bd385 tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1203.472619] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1203.472931] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.473064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.473123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.473315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.473469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.473563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.473616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.473755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.473839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.473930] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.495102] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.737893] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.738118] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.738275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.738554] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.738816] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.738981] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.739117] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.739344] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.739496] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.739709] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.739826] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.739940] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.740068] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.740183] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.740292] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.740426] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.762338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.762513] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1203.762656] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.762831] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-142" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.763156] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-43498ec1-74bf-4ac8-9ec3-768fe79eb044 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.763336] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.763462] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.763779] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.763954] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43498ec1-74bf-4ac8-9ec3-768fe79eb044',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.976574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.976744] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.976797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.977096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.977206] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.977404] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.977505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.977567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.977723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.977801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.977888] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1203.997049] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.997157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.997191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.997359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.997442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.997534] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be updated. [ 1204.003458] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.003573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.003642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.003799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.003927] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.010897] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1204.023654] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.023767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.023844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.023993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.024128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.032016] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: IN_PROGRESS for 2s [ 1204.266208] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.266467] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.266602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.266922] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.267141] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.267329] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 43498ec1-74bf-4ac8-9ec3-768fe79eb044 not found, creating... [ 1204.267652] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.267838] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.267960] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.268250] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.268376] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.268663] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.269067] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.269067] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.269174] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.269306] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.269453] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 43498ec1-74bf-4ac8-9ec3-768fe79eb044 is going to be created. [ 1204.288178] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.288398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.288531] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.288781] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.289022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.289251] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.966159] env[68828]: INFO networking_nsxv3.common.synchronization [req-7aafab82-ae77-4f63-9ebc-08f269cc39b7 req-86754549-ddaf-422a-bc1e-78eaf948aa7c service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1204.966516] env[68828]: INFO networking_nsxv3.common.synchronization [req-7aafab82-ae77-4f63-9ebc-08f269cc39b7 req-86754549-ddaf-422a-bc1e-78eaf948aa7c service nova] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1204.966516] env[68828]: INFO networking_nsxv3.common.synchronization [req-7aafab82-ae77-4f63-9ebc-08f269cc39b7 req-86754549-ddaf-422a-bc1e-78eaf948aa7c service nova] Enqueued Resource ID: 43498ec1-74bf-4ac8-9ec3-768fe79eb044 with Priority: HIGHEST for action port [ 1204.966731] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_rules [ 1204.966872] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1204.967108] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43498ec1-74bf-4ac8-9ec3-768fe79eb044 with Priority: HIGHEST for action port [ 1204.967607] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.967734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.968355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.968355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.968355] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.968988] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.969116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.969303] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-43498ec1-74bf-4ac8-9ec3-768fe79eb044 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.969423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.969489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.969637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.969758] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43498ec1-74bf-4ac8-9ec3-768fe79eb044',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.471699] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.471913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.472099] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43498ec1-74bf-4ac8-9ec3-768fe79eb044 with status ACTIVE [ 1205.472284] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.472356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.472454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.472636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.472730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.472901] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.472998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.473081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.473224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.473304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.473484] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.473578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.473639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.473775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.473870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.473963] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43498ec1-74bf-4ac8-9ec3-768fe79eb044 is going to be updated. [ 1205.495495] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.495682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.495733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.495961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.496145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.496303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43498ec1-74bf-4ac8-9ec3-768fe79eb044" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.021362] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1206.021710] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1206.021710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.021810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.021987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.022181] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.022325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.022425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.022522] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.022601] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.022693] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.040620] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1206.040811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.524997] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.026969] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.530159] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.530550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.530550] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.530628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.530694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.530791] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1207.560198] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.560345] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.560412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.560641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.560793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.569141] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1208.777066] env[68828]: INFO networking_nsxv3.common.synchronization [req-7a9f2d81-fe8e-463a-8d1d-edd43269dc23 req-bbe2a50c-96ee-4be5-8ab1-25d79346e4cf tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1208.777774] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGHEST for action security_group_members [ 1208.778229] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.778410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.778515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.778805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.779076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.779235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.779335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.779801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.779944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.780109] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.284010] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.284010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.284010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.284010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.284010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.284314] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.284314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.284399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.284520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.284603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.284691] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be updated. [ 1209.313179] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.313338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.313387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.313583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.313719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.321432] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: IN_PROGRESS for 2s [ 1209.578873] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1209.579141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.579324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.579566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.579778] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.579937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.580037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.580245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.580342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.580413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.580502] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.083425] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.083736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.083736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.083883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.084083] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.084195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.084255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.085030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.085030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.085030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.085030] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.085030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.085030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.085030] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.085311] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.085311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.085311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.085405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.085431] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.085514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.085603] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.313368] env[68828]: INFO networking_nsxv3.common.synchronization [req-b979a7dd-52c4-4ea2-adc4-e40991a259e4 req-17bdc54c-b7bc-4fd6-9271-800690e7119e tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1210.313368] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGHEST for action security_group_members [ 1210.313574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.313813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.314033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.314430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.314681] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.314901] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.315077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.315320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.315506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.315677] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.587253] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25c2ea4d-ec48-482b-ad32-9b9a12f4793a: rpc.has_security_group_logging(os_id): False [ 1210.604586] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.604759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.604801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.605125] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.605221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.605517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.605676] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.605734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.605851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.605928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.606299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.606418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.606485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.606633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.606712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.606906] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.606993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.607209] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.607360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.607438] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.607526] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1210.680821] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.680970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.681272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.681354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.681477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.695749] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1210.819704] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.819883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.819943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.820171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.820418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.820490] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.820582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.820641] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.820799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.820877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.820964] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea is going to be updated. [ 1210.851020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.851168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.851240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.851425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.851649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.860309] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: IN_PROGRESS for 2s [ 1211.330530] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54442a91-18b6-4b09-9577-94704b92215d in Status: SUCCESS [ 1211.330762] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54442a91-18b6-4b09-9577-94704b92215d deletion is rescheduled due to dependency. [ 1211.330838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.712224] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1212.712735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.869290] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea in Status: SUCCESS [ 1212.869591] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea deletion is rescheduled due to dependency. [ 1212.869591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.249526] env[68828]: INFO networking_nsxv3.common.synchronization [None req-d92e6f0b-a6c0-459f-9be1-c789cc8b2744 tempest-AttachInterfacesTestJSON-1739478489 tempest-AttachInterfacesTestJSON-1739478489-project-member] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1213.250054] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGHEST for action security_group_members [ 1213.250933] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.250933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.250933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.250933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.250933] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.251210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.251210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.251210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.251295] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.251379] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.753675] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.753990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.753990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.754463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.754463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.754463] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.754632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.754632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.754784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.754860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.754947] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be updated. [ 1213.782907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.783059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.783134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.783332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.783468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.791346] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: IN_PROGRESS for 2s [ 1214.316410] env[68828]: INFO networking_nsxv3.common.synchronization [None req-3ee06deb-0649-4c8e-bdb5-a4779bc441f7 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_rules [ 1214.317082] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_rules [ 1214.317375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.317532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.317532] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.317795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.317878] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.389188] env[68828]: INFO networking_nsxv3.common.synchronization [None req-a5bbc406-f25e-4fd4-9796-05cd7b15a1d0 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_rules [ 1214.389677] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_rules [ 1214.390052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.390170] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.839251] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.839629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.839629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.840557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.840557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.840557] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 already deleted. [ 1214.840557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.840557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.840557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.840557] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.328400] env[68828]: INFO networking_nsxv3.common.synchronization [None req-86c877ee-afd8-4584-891f-e6d613e298c9 tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1215.328400] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1215.328400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.328400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.328400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.328595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.328676] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.360920] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.361074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.361145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.361374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.361462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.361558] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 already deleted. [ 1215.361639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.408472] env[68828]: INFO networking_nsxv3.common.synchronization [None req-55b7d044-cc67-435b-8f77-ea4b10e796fc tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1215.408960] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1215.409301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.409377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.801244] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 in Status: SUCCESS [ 1215.801642] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 deletion is rescheduled due to dependency. [ 1215.801806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.849971] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.850255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.850255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.850531] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.850725] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.850858] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f5421a-1862-4f08-954d-478178c2eacc already deleted. [ 1215.851401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.851401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.851401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.851401] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.371058] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.371279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.371357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.371573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.371661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.371759] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f5421a-1862-4f08-954d-478178c2eacc already deleted. [ 1216.371842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.387378] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e5f5667-e8b0-4556-85a2-e1f9b81e8bbe req-9df8ef52-f28e-497c-a2cd-9a524da0f5c9 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_members [ 1220.388718] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_members [ 1220.388718] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.388718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.388718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.388718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.388919] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.388919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.388919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.392774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.392774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.392774] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.646932] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.647221] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.647383] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.647826] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.647965] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.649253] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.649253] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.649253] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.649253] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.649253] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.649253] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.649253] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.649253] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.649635] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1220.649635] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.649635] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.669728] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.669927] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.670087] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.670281] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.670580] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-092c659b-e952-4ace-982a-4091e177591b taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.670752] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.670874] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.671243] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.671412] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('092c659b-e952-4ace-982a-4091e177591b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.891972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.892270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.892368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.892617] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.892754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.893013] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.893152] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.893221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.893519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.893624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.893730] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 already deleted. [ 1220.893829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.173829] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.173829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.173829] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.174928] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.174928] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.174928] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 092c659b-e952-4ace-982a-4091e177591b not found, creating... [ 1221.174928] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.175209] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.175209] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.175388] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.175530] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.175826] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.176022] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.176197] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.176450] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.176649] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.176845] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 092c659b-e952-4ace-982a-4091e177591b is going to be created. [ 1221.198789] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.199043] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.199201] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.199564] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.199770] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.200031] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.879771] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e5f5667-e8b0-4556-85a2-e1f9b81e8bbe req-183695da-84e2-4bb7-898f-9a2aa9675ec0 service nova] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_rules [ 1221.880066] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e5f5667-e8b0-4556-85a2-e1f9b81e8bbe req-183695da-84e2-4bb7-898f-9a2aa9675ec0 service nova] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_members [ 1221.880159] env[68828]: INFO networking_nsxv3.common.synchronization [req-8e5f5667-e8b0-4556-85a2-e1f9b81e8bbe req-183695da-84e2-4bb7-898f-9a2aa9675ec0 service nova] Enqueued Resource ID: 092c659b-e952-4ace-982a-4091e177591b with Priority: HIGHEST for action port [ 1221.880374] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_rules [ 1221.880508] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_members [ 1221.880604] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 092c659b-e952-4ace-982a-4091e177591b with Priority: HIGHEST for action port [ 1221.881281] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.881454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.881545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.881771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.881880] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.883276] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.883395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.883462] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.883630] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.883846] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.883938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.884068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.884248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.884382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.884493] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.885274] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-092c659b-e952-4ace-982a-4091e177591b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.885408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.885496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.885672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.885779] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('092c659b-e952-4ace-982a-4091e177591b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.387337] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.387534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.389828] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.390714] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 092c659b-e952-4ace-982a-4091e177591b with status ACTIVE [ 1222.390898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.391029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.391099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.391306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.391388] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.391565] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.391664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.391726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.391873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.391949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.392148] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.392248] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.392300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.392432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.392505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.392589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 092c659b-e952-4ace-982a-4091e177591b is going to be updated. [ 1222.418286] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.418286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.419025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.419025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.419025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.419025] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-092c659b-e952-4ace-982a-4091e177591b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.597282] env[68828]: INFO networking_nsxv3.common.synchronization [req-85ef8e39-4670-47c1-9968-1cedf2808f4f req-fa0966bf-27a9-444e-8c49-7d713a1e5cb3 tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1222.597792] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1222.598225] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.598387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.598482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.598799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.599017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.599154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.599241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.599446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.599597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.599717] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.871244] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.871931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.871931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.871931] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.872143] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.872264] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.872381] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.872590] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.872734] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.872937] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1222.873067] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1222.873181] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1222.873298] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1222.873411] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1222.873520] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1222.873654] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1222.892421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1222.892699] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1222.892748] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1222.892879] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.893221] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.893398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.893522] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.893946] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.894198] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.895193] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.103359] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.103545] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.103589] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.103783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.103873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.104081] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.104211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.104273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.104424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.104500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.104629] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f5421a-1862-4f08-954d-478178c2eacc already deleted. [ 1223.104739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.397283] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.397548] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.397680] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.397966] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.398138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.398297] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a not found, creating... [ 1223.398566] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.398725] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.399905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.399905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.399905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.399905] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.399905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.399905] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.400175] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.400175] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.400239] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a is going to be created. [ 1223.401470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.401605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.401652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.401792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.401867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.401953] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 is going to be created. [ 1223.420370] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.420559] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.420732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.420986] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.421224] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.421447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.425756] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.425880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.425966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.426104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.426292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.435183] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 in Status: UNINITIALIZED for 2s [ 1224.089680] env[68828]: INFO networking_nsxv3.common.synchronization [req-85ef8e39-4670-47c1-9968-1cedf2808f4f req-ca6fba69-7f7b-402a-9ea6-610e8b45cc18 service nova] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1224.089912] env[68828]: INFO networking_nsxv3.common.synchronization [req-85ef8e39-4670-47c1-9968-1cedf2808f4f req-ca6fba69-7f7b-402a-9ea6-610e8b45cc18 service nova] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1224.090075] env[68828]: INFO networking_nsxv3.common.synchronization [req-85ef8e39-4670-47c1-9968-1cedf2808f4f req-ca6fba69-7f7b-402a-9ea6-610e8b45cc18 service nova] Enqueued Resource ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a with Priority: HIGHEST for action port [ 1224.090295] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1224.090427] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1224.090571] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a with Priority: HIGHEST for action port [ 1224.091377] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.091575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.091684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.092007] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.092121] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.092972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.093301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.093301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.093389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.093793] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.093856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.093903] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.094090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.094190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.094281] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.094975] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.095094] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.095164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.095311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.095385] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.597599] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.597685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.597830] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.600939] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a with status ACTIVE [ 1224.600939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.600939] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.600939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.601363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.601363] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.601363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.601363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.601498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.601498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.601560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a is going to be updated. [ 1224.620433] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.620688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.620688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.620807] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.620933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.621134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.103450] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.444279] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 in Status: SUCCESS [ 1225.444501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.444664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.444893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.445103] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.445222] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.445290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.445455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.445576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.445677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.445769] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.605733] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.605825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.605892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.606155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.606333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.606409] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be created. [ 1225.628736] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.628895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.628937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.629197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.629395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.638384] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: UNINITIALIZED for 2s [ 1225.948125] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.451725] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dd0ece4-c4cb-4634-93e2-7a904a6189e5: rpc.has_security_group_logging(os_id): False [ 1226.471091] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.471309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.471309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.471547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.471640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.471882] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.471982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.472088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.472208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.472285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.472373] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 is going to be created. [ 1226.526873] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.527012] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.527089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.527343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.527540] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.545159] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 in Status: IN_PROGRESS for 2s [ 1227.647922] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: SUCCESS [ 1227.648279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.648316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.648543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.648736] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.648855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.648921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.649096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.649181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.649294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.649399] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.151708] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.556446] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 in Status: SUCCESS [ 1228.556669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.654868] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f5421a-1862-4f08-954d-478178c2eacc: rpc.has_security_group_logging(os_id): False [ 1228.675970] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.677051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.677051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.677051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.677051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.677250] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.677250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.677329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.677512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.677596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.677715] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be created. [ 1228.736796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.736993] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.737103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.737381] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.737579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.750602] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: IN_PROGRESS for 2s [ 1229.091742] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1229.091863] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1230.766714] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: SUCCESS [ 1230.767201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.092832] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1234.092832] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1234.191071] env[68828]: INFO networking_nsxv3.common.synchronization [req-1ed6613c-04fe-40cd-a7f4-743805bf4770 req-323bc3b5-d7b1-486e-94a9-616f9e5fccde tempest-AttachVolumeNegativeTest-2037306703 tempest-AttachVolumeNegativeTest-2037306703-project-member] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_members [ 1234.192143] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGHEST for action security_group_members [ 1234.192659] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.193024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.193024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.193163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.193338] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.193448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.193510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.193680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.193763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.193860] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.697948] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.698129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.698203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.698435] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.698541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.698759] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.698862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.698937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.699124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.699204] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.699296] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a771ab20-d012-4cc4-a555-22b26893f658 is going to be updated. [ 1234.734499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.734669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.734717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.734885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.735027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.744273] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a771ab20-d012-4cc4-a555-22b26893f658 in Status: IN_PROGRESS for 2s [ 1236.753738] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a771ab20-d012-4cc4-a555-22b26893f658 in Status: SUCCESS [ 1236.754135] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a771ab20-d012-4cc4-a555-22b26893f658 deletion is rescheduled due to dependency. [ 1236.754135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.193498] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.193935] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1244.056754] env[68828]: INFO networking_nsxv3.common.synchronization [req-45a37042-fd04-4430-a0a3-b35e10c40658 req-2197c7a4-229d-4762-b586-fdaf3f82a8dc tempest-DeleteServersTestJSON-1071534319 tempest-DeleteServersTestJSON-1071534319-project-member] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1244.056754] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGHEST for action security_group_members [ 1244.056754] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.056754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.057443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.057443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.057443] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.057443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.057443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.057443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.057655] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.057655] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.560743] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.561074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.561157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.561382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.561475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.561685] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.561792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.561856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.562015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.562099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.562189] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be updated. [ 1244.589017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.589203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.589283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.589408] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.589539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.597283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: IN_PROGRESS for 2s [ 1246.608778] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a in Status: SUCCESS [ 1246.609099] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a deletion is rescheduled due to dependency. [ 1246.609099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.057645] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.058037] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1253.910891] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1253.911254] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1254.058584] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.058781] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1259.059391] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.059845] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.060094] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.060416] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.852180] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.852410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.852410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.852631] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.852742] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.354593] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.856663] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.359233] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1266.359586] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1267.104337] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.104516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.104573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.104777] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.115882] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1267.116750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.117652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1267.156054] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.156054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.156054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.156270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.170512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.171339] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1267.171417] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.171514] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1267.206802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.206802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.206802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.206802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.208081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.208270] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1267.286538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.286693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.286795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.287008] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.287323] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.287608] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1267.360347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.360347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.360347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.360347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.360347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.360801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1267.360801] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2a8420bd-ff5b-46bf-9912-8f61665f7b94', 'd03381a0-8611-467b-849f-03e37e47978c', '2e89052b-2796-4bf5-84ca-4753e088c73a', '25c2ea4d-ec48-482b-ad32-9b9a12f4793a', '54442a91-18b6-4b09-9577-94704b92215d', '3fdb4832-fb6b-46dc-9929-5e545ccfc219', '17f5421a-1862-4f08-954d-478178c2eacc', '0c1aa990-7ca3-4056-913b-d8a56e8959ea', '7f3199ec-0e4d-4ae9-8c43-76701bbf9090', 'cb041b18-87bc-4915-afe4-a638542c6e17', '061e7957-d08e-4436-88e2-d8f6b78364a8', '72db73c0-ef70-4c2d-8bf5-f9c100c17e9c', '4fb8087b-3cde-4101-b157-953a51b3561f', '309bda50-1db3-47e1-b12b-431331217ccd', '7a27e33a-25e2-461a-8cee-d5aba5ff9550', '44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa', '2f4a4187-5566-42ed-af79-13c7cf7b4577', 'd71fe85b-2b15-476f-8dc2-6739692bced0', 'c55eb713-452e-4803-84ae-58a048b5a359', 'a771ab20-d012-4cc4-a555-22b26893f658', '14ffdab8-bf16-471f-9412-c5026034844d', '55fbd6f6-2090-4d92-ac03-c7ce1819a7d1', '49bff80d-9c54-4a44-a1a9-f388114a1a64', '27a4adfb-8bb8-4644-a926-1d5f3c8693cd', 'df1d5f70-a74c-42f7-ac16-3a22419f5e48', '2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a', '6547eb98-d904-4822-951d-00fe16de337d', 'f9050286-eb81-4cbb-9bd8-733baee0e20c', 'e6a0522b-dbc3-42bf-8801-b6e755596373', '7c70394b-e7ce-40e9-946e-b190f72998f8', 'd681bb4b-ff28-46df-b3fb-b660a07ce6c2', '4dd0ece4-c4cb-4634-93e2-7a904a6189e5', '37ec0117-a289-428f-9466-58f2541a90c7', '448a7f6d-e5f6-4ab8-9c7c-330542177864', 'ee881f3c-d61c-4373-931c-252d84c5ac2b', '33e63aa4-edf9-4cdd-b540-1791bfdc42d4', '0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff', 'a40c3045-d4de-46b9-862d-aaeccc547265', 'e9f41e17-e083-4115-b3db-6fcd432d4982', '4ccb4815-10bb-46a0-9b26-0a53fb6c8347'} {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.360801] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1267.377896] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.378055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.378129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.378297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.378413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.378485] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1267.378558] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.378632] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1267.447418] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.447566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.447609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.447785] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.448949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.449218] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1267.449300] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1267.449373] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1267.449442] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1267.449520] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1267.449593] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGH for action security_group_rules [ 1267.449673] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGH for action security_group_rules [ 1267.449753] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGH for action security_group_rules [ 1267.449839] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGH for action security_group_rules [ 1267.449904] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGH for action security_group_rules [ 1267.449963] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGH for action security_group_rules [ 1267.450032] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGH for action security_group_rules [ 1267.450096] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGH for action security_group_rules [ 1267.450149] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGH for action security_group_rules [ 1267.450201] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGH for action security_group_rules [ 1267.450261] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGH for action security_group_rules [ 1267.450326] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGH for action security_group_rules [ 1267.450375] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGH for action security_group_rules [ 1267.450439] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGH for action security_group_rules [ 1267.450495] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGH for action security_group_rules [ 1267.450558] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGH for action security_group_rules [ 1267.450614] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGH for action security_group_rules [ 1267.450677] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGH for action security_group_rules [ 1267.450738] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGH for action security_group_rules [ 1267.450796] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGH for action security_group_rules [ 1267.450889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.061485] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.061749] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1269.061749] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGH for action security_group_rules [ 1269.061862] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e89052b-2796-4bf5-84ca-4753e088c73a with Priority: HIGH for action security_group_rules [ 1269.061964] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGH for action security_group_rules [ 1269.062080] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 with Priority: HIGH for action security_group_rules [ 1269.062176] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a771ab20-d012-4cc4-a555-22b26893f658 with Priority: HIGH for action security_group_rules [ 1269.062313] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55eb713-452e-4803-84ae-58a048b5a359 with Priority: HIGH for action security_group_rules [ 1269.062524] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71fe85b-2b15-476f-8dc2-6739692bced0 with Priority: HIGH for action security_group_rules [ 1269.062571] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 with Priority: HIGH for action security_group_rules [ 1269.062647] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 309bda50-1db3-47e1-b12b-431331217ccd with Priority: HIGH for action security_group_rules [ 1269.062727] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa with Priority: HIGH for action security_group_rules [ 1269.062887] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb8087b-3cde-4101-b157-953a51b3561f with Priority: HIGH for action security_group_rules [ 1269.062930] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c with Priority: HIGH for action security_group_rules [ 1269.062997] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 with Priority: HIGH for action security_group_rules [ 1269.063099] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGH for action security_group_rules [ 1269.063225] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGH for action security_group_rules [ 1269.063284] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 with Priority: HIGH for action security_group_rules [ 1269.063355] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea with Priority: HIGH for action security_group_rules [ 1269.063437] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54442a91-18b6-4b09-9577-94704b92215d with Priority: HIGH for action security_group_rules [ 1269.063521] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d03381a0-8611-467b-849f-03e37e47978c with Priority: HIGH for action security_group_rules [ 1269.063605] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a with Priority: HIGH for action security_group_rules [ 1269.063945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.064088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.064153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.064351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.064434] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.065727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e89052b-2796-4bf5-84ca-4753e088c73a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.065941] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.066105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.066260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.066344] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e89052b-2796-4bf5-84ca-4753e088c73a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.067147] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.071029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.071029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.071029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.071029] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.071029] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.071029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.071029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.071029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.071029] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a27e33a-25e2-461a-8cee-d5aba5ff9550',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.072134] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a771ab20-d012-4cc4-a555-22b26893f658 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.072246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.072322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.072499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.072557] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a771ab20-d012-4cc4-a555-22b26893f658',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.073462] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c55eb713-452e-4803-84ae-58a048b5a359 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.073580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.073666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.073819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.073906] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c55eb713-452e-4803-84ae-58a048b5a359',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.074639] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71fe85b-2b15-476f-8dc2-6739692bced0 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.074781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.074847] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.075389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.075389] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71fe85b-2b15-476f-8dc2-6739692bced0',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.075808] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4a4187-5566-42ed-af79-13c7cf7b4577 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.075915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.075984] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.076165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.076238] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4a4187-5566-42ed-af79-13c7cf7b4577',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.076945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-309bda50-1db3-47e1-b12b-431331217ccd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.077063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.077140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.077285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.077368] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('309bda50-1db3-47e1-b12b-431331217ccd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.078220] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.078288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.078334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.078584] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.078584] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.082132] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fb8087b-3cde-4101-b157-953a51b3561f taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.082132] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fb8087b-3cde-4101-b157-953a51b3561f',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.082132] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.082132] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72db73c0-ef70-4c2d-8bf5-f9c100c17e9c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.082132] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-061e7957-d08e-4436-88e2-d8f6b78364a8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.082132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.082132] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('061e7957-d08e-4436-88e2-d8f6b78364a8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.082863] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.082989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.083054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.083219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.083287] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.084057] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.084167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.084234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.084374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.084449] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.085146] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.085281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.085327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.085498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.085569] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fdb4832-fb6b-46dc-9929-5e545ccfc219',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.086413] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.086523] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.086604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.086859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.086859] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c1aa990-7ca3-4056-913b-d8a56e8959ea',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.087524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54442a91-18b6-4b09-9577-94704b92215d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.087642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.087715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.088168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.088168] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54442a91-18b6-4b09-9577-94704b92215d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.088719] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d03381a0-8611-467b-849f-03e37e47978c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.088823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.088934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.089121] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.089206] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d03381a0-8611-467b-849f-03e37e47978c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.089973] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.090086] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.090154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.090316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.090390] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25c2ea4d-ec48-482b-ad32-9b9a12f4793a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.595322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.595530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.595530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.595699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.595893] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.596067] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.596123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.596242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.596329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.596416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.596503] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.597426] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.597548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.597738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.597738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.598304] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.598304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.598304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.598304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.598304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.598507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.598507] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.599956] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.600077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.600077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.600257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.600841] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.600841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.600841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.600841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.600841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.601070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.601070] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.621379] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.630151] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb041b18-87bc-4915-afe4-a638542c6e17: rpc.has_security_group_logging(os_id): False [ 1269.649796] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.649981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.649981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.650195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.760907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.761130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.764011] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.764147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.764911] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.765078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.765750] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.765844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.766596] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.766715] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.767434] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.767525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.768250] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.768369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.769133] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.769236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.769940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.770051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.770799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.770895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.771554] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.772015] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.772091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.772730] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.773171] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.773268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.776213] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.776663] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.776762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.777810] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.778276] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.778374] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.778984] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.779459] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.779554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.780189] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.780583] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.780672] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.781307] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.781694] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.781788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.789764] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.790268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.790389] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e89052b-2796-4bf5-84ca-4753e088c73a is going to be deleted. [ 1269.791297] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.791509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.809604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.809716] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa is going to be deleted. [ 1269.810436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.810621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.827650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.827770] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4a4187-5566-42ed-af79-13c7cf7b4577 is going to be deleted. [ 1269.828485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.828662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.848053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.848141] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fb8087b-3cde-4101-b157-953a51b3561f is going to be deleted. [ 1269.849465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.849465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.869440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.869617] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d03381a0-8611-467b-849f-03e37e47978c is going to be deleted. [ 1269.870272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.870432] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.872722] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.872846] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.887523] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.887652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.894669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.894824] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c55eb713-452e-4803-84ae-58a048b5a359 is going to be deleted. [ 1269.895809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.896017] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.916443] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.916565] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.920534] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.920647] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be deleted. [ 1269.921373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.921557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.944378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.944505] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a27e33a-25e2-461a-8cee-d5aba5ff9550 is going to be deleted. [ 1269.945241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.945422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.949700] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.949815] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.965357] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.965471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.016838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.016991] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 061e7957-d08e-4436-88e2-d8f6b78364a8 is going to be deleted. [ 1270.017875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.018091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.061907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.062283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.088018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.088201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.090163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.090291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.107117] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.107226] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c1aa990-7ca3-4056-913b-d8a56e8959ea is going to be deleted. [ 1270.108151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.108390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.112939] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.116552] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.169945] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.170129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.199657] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.199799] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72db73c0-ef70-4c2d-8bf5-f9c100c17e9c is going to be deleted. [ 1270.200706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.200921] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.264574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.264753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.287078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.287252] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a771ab20-d012-4cc4-a555-22b26893f658 is going to be deleted. [ 1270.288184] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.288401] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.353770] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.353934] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54442a91-18b6-4b09-9577-94704b92215d is going to be deleted. [ 1270.354805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.355028] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.390170] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.390367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.414301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.414485] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fdb4832-fb6b-46dc-9929-5e545ccfc219 is going to be deleted. [ 1270.415367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.415618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.477582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.477769] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25c2ea4d-ec48-482b-ad32-9b9a12f4793a is going to be deleted. [ 1270.478654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.478871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.480628] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.480767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.550803] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.550981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.559976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.560121] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71fe85b-2b15-476f-8dc2-6739692bced0 is going to be deleted. [ 1270.561084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.561326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.599891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.600072] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 309bda50-1db3-47e1-b12b-431331217ccd is going to be deleted. [ 1270.600950] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.601171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.614985] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f5421a-1862-4f08-954d-478178c2eacc: rpc.has_security_group_logging(os_id): False [ 1270.618644] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3199ec-0e4d-4ae9-8c43-76701bbf9090: rpc.has_security_group_logging(os_id): False [ 1270.641951] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.642133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.654974] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.655141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.656509] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.656598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.704219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.704534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.704632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.704702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.704906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.704991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.705105] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be updated. [ 1270.706149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.706363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.706453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.706576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e89052b-2796-4bf5-84ca-4753e088c73a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.706708] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.706902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.707014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.707190] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4a4187-5566-42ed-af79-13c7cf7b4577" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.707395] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.707582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.707682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.707832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44f6efa0-fbbb-478f-9cf0-3d9c2da62aaa" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.707975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.708144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.708223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.708425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fb8087b-3cde-4101-b157-953a51b3561f" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.708866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.709096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.709212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.709359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d03381a0-8611-467b-849f-03e37e47978c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.709511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.709689] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.709805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.709951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.710126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.710276] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.710352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.710467] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c55eb713-452e-4803-84ae-58a048b5a359" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.710581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.710763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.710828] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.710895] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a27e33a-25e2-461a-8cee-d5aba5ff9550" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.711072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.711247] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.711331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.711453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-061e7957-d08e-4436-88e2-d8f6b78364a8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.711577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.711718] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.711794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.711906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c1aa990-7ca3-4056-913b-d8a56e8959ea" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.712042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.712288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.712288] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.712383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72db73c0-ef70-4c2d-8bf5-f9c100c17e9c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.712498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.712660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.712755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.712894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a771ab20-d012-4cc4-a555-22b26893f658" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.713232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.713320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54442a91-18b6-4b09-9577-94704b92215d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713591] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.713752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.713849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fdb4832-fb6b-46dc-9929-5e545ccfc219" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.714324] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.714520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.732349] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.732529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.758163] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.758325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.760792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.761077] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.761172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.761242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.761443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.761528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.761652] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be updated. [ 1270.762690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.762822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.809652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.809941] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.810056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.810127] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.810394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.810466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.810504] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1270.811561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.811729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.811829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.811935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-309bda50-1db3-47e1-b12b-431331217ccd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.812077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.812259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.812343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.812452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25c2ea4d-ec48-482b-ad32-9b9a12f4793a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.813183] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.813306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.813396] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.813517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.813595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.813700] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71fe85b-2b15-476f-8dc2-6739692bced0" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.900999] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.901220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.901220] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.901403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.901544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.946081] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.946208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.946284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.946478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.946615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.987663] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: IN_PROGRESS for 2s [ 1270.988512] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1271.016265] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.016421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.016488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.016639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.016819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.062241] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1273.003151] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: SUCCESS [ 1273.003520] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.004111] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1273.004306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.075016] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1273.075275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.065016] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.065291] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1278.866053] env[68828]: INFO networking_nsxv3.common.synchronization [req-64108788-cfee-4032-ac4e-7a112f823a20 req-a702ca37-b4d7-4678-babf-9519641dd3da tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1278.866586] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1278.866925] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.867077] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.867147] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.867338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.867516] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.867621] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.867679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.867885] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.868013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.868127] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.370076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.370282] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.370356] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.370567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.391506] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.391772] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.391890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.391958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.392161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.392245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.392331] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1279.416643] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.416803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.416860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.417049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.417203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.424191] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1281.436331] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1281.436712] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd deletion is rescheduled due to dependency. [ 1281.436712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.868152] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.868547] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.028168] env[68828]: INFO networking_nsxv3.common.synchronization [req-e2cf60d3-aa8c-496a-8f9a-97a5979fce6b req-2254d5fc-9279-45be-9827-575a6e9805ef tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1287.028682] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1287.029065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.029155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.029211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.029494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.029494] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.029627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.029677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.029780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.029863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.029954] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.308162] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.308409] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.308487] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.308757] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.309849] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.309849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.309849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.309849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.309849] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.310230] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1287.310230] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1287.310230] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1287.310321] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1287.310417] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1287.310544] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1287.310686] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1287.328986] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1287.329265] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1287.329433] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1287.329613] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.329918] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.330109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.330237] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.330560] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.330703] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4916eb52-f3fa-46d2-8b60-d7ca265ad34e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.532019] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.532252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.532252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.532483] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.532574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.532766] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.532855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.532915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.533081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.533151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.533238] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1287.557108] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.557108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.557108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.557300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.558568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.565853] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1287.832796] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.833087] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.833124] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.833398] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.833555] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.833713] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 4916eb52-f3fa-46d2-8b60-d7ca265ad34e not found, creating... [ 1287.833969] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.834147] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.834343] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.834508] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.834621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.834921] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.835110] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.835239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.835452] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.835591] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.835734] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e is going to be created. [ 1287.854059] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.854234] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.854365] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.854618] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.854860] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.855114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.523495] env[68828]: INFO networking_nsxv3.common.synchronization [req-e2cf60d3-aa8c-496a-8f9a-97a5979fce6b req-268b6262-a888-48b9-a047-d4382de9603f service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1288.523495] env[68828]: INFO networking_nsxv3.common.synchronization [req-e2cf60d3-aa8c-496a-8f9a-97a5979fce6b req-268b6262-a888-48b9-a047-d4382de9603f service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1288.524062] env[68828]: INFO networking_nsxv3.common.synchronization [req-e2cf60d3-aa8c-496a-8f9a-97a5979fce6b req-268b6262-a888-48b9-a047-d4382de9603f service nova] Enqueued Resource ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e with Priority: HIGHEST for action port [ 1288.524062] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1288.524062] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1288.524206] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e with Priority: HIGHEST for action port [ 1288.524791] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.524868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.524948] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.525240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.525324] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.526564] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.526666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.526879] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.527024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.527104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.527261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.527334] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4916eb52-f3fa-46d2-8b60-d7ca265ad34e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.029799] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.030031] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.030158] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4916eb52-f3fa-46d2-8b60-d7ca265ad34e with status ACTIVE [ 1289.030329] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.030464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.030500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.030737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.030773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.030942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.031052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.031100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.031239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.031312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.031488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.031596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.031639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.031775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.031858] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.031908] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e is going to be updated. [ 1289.052020] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.052176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.052275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.052367] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.052484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.052626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.574973] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1289.575302] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd deletion is rescheduled due to dependency. [ 1289.575302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.575425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.575628] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.575801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.575915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.575981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.576145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.576226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.576316] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.693520] env[68828]: INFO networking_nsxv3.common.synchronization [req-b9245bc0-d218-412e-92ad-4d198d04200b req-f6757aca-ae24-404b-9fe3-1d45c9172695 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_members [ 1289.694039] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGHEST for action security_group_members [ 1289.694682] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.694682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.694682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.694823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.694854] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.694943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.695026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.695151] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.695227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.695316] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.079561] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.198313] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.198493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.198555] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.198786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.219386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.219648] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.219766] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.219835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.220052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.220138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.220228] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 is going to be updated. [ 1290.244228] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.244427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.244427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.244632] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.244773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.266789] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 in Status: IN_PROGRESS for 2s [ 1290.582088] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.084972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.085141] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.085192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.085383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.085478] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.085579] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1291.113961] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.113961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.113961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.113961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.113961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.124440] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1292.275855] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 in Status: SUCCESS [ 1292.276196] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 deletion is rescheduled due to dependency. [ 1292.276196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.131956] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1293.132106] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.132284] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.132774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.132774] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.132909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.132909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.133101] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.133243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.133304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.133351] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.635894] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.138093] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27a4adfb-8bb8-4644-a926-1d5f3c8693cd: rpc.has_security_group_logging(os_id): False [ 1294.155261] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.155403] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.155474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.155684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.155790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.156080] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.156199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.156273] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.156437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.156515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.156600] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1294.214904] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.214904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.214904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.214904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.214904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.225500] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1294.694625] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.694941] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1296.239878] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1296.239878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.457588] env[68828]: INFO networking_nsxv3.common.synchronization [req-90644a42-a428-423c-bd23-8b9d3b5e5d87 req-3607043f-225b-4603-8d20-8ae4e04c95ec tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1299.457917] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1299.458274] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.458548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.458548] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.458702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.458822] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.458918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.458975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.459136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.459223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.459315] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.684811] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.685034] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.685204] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.685488] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.685749] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.685916] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.686050] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.686275] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.686426] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.686644] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.686765] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.686877] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.686988] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.687164] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.687296] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.687433] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.706198] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.706354] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1299.706491] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.706653] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.706927] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-93406906-c170-4412-848a-499e8094549d taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.707139] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.707289] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.707576] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.707719] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93406906-c170-4412-848a-499e8094549d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.961356] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.961559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.961559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.961735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.961829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.962026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.962126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.962188] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.962336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.962417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.962505] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be deleted. [ 1299.997690] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.997865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.997865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.998044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.998159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.998304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.210480] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.210756] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.210894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.211210] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.211387] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.211524] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 93406906-c170-4412-848a-499e8094549d not found, creating... [ 1300.211790] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.211950] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.212086] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.212309] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.212445] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.212731] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.212892] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.213025] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.213237] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.213378] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.213521] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 93406906-c170-4412-848a-499e8094549d is going to be created. [ 1300.231152] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.231357] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.231468] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.231706] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.231929] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.232192] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.945984] env[68828]: INFO networking_nsxv3.common.synchronization [req-90644a42-a428-423c-bd23-8b9d3b5e5d87 req-48c612d1-0a47-4f06-b350-def674f8673f service nova] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_rules [ 1300.946249] env[68828]: INFO networking_nsxv3.common.synchronization [req-90644a42-a428-423c-bd23-8b9d3b5e5d87 req-48c612d1-0a47-4f06-b350-def674f8673f service nova] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1300.946401] env[68828]: INFO networking_nsxv3.common.synchronization [req-90644a42-a428-423c-bd23-8b9d3b5e5d87 req-48c612d1-0a47-4f06-b350-def674f8673f service nova] Enqueued Resource ID: 93406906-c170-4412-848a-499e8094549d with Priority: HIGHEST for action port [ 1300.946547] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_rules [ 1300.946679] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1300.946774] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93406906-c170-4412-848a-499e8094549d with Priority: HIGHEST for action port [ 1300.947373] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.947516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.947556] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.947759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.947840] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.949502] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.949502] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.949599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.949737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.949890] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.949986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.950061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.950208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.950293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.950379] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.951475] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-93406906-c170-4412-848a-499e8094549d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.951586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.951654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.951803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.951879] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93406906-c170-4412-848a-499e8094549d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.454804] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.454804] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.454804] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.455371] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93406906-c170-4412-848a-499e8094549d with status ACTIVE [ 1301.455570] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.455687] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.455761] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.456029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.456129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.456304] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.456398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.456460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.456615] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.456691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.456861] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.456953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.457026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.457167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.457243] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.457339] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93406906-c170-4412-848a-499e8094549d is going to be updated. [ 1301.478561] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.478705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.478748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.478908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.479049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.479201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.959098] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.426809] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.427054] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.427292] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.427674] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.428061] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.428297] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.428465] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.428723] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.428888] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.429711] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.431036] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.431036] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.431036] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.431036] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.431036] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.431036] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.447681] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.447852] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1302.447993] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.448196] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-302" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.448498] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.448672] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.448797] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.449081] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.449282] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.460968] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.461119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.461119] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.461331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.461376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.461585] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be created. [ 1302.481887] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.482044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.482134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.482328] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.482485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.490461] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: UNINITIALIZED for 2s [ 1302.952405] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.952644] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.952806] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.953210] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.953417] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.953742] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.953978] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.954146] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.954429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.954619] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.955035] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.955159] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.955331] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.955581] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.955754] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.955930] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a is going to be updated. [ 1302.981850] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.982193] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.982251] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.982522] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.982747] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.982996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.680921] env[68828]: INFO networking_nsxv3.common.synchronization [req-853f7378-b786-4ec8-a89b-25259141fb55 req-37a144cf-2c63-417f-bc84-613f46b1d3e8 service nova] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1303.681130] env[68828]: INFO networking_nsxv3.common.synchronization [req-853f7378-b786-4ec8-a89b-25259141fb55 req-37a144cf-2c63-417f-bc84-613f46b1d3e8 service nova] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1303.681307] env[68828]: INFO networking_nsxv3.common.synchronization [req-853f7378-b786-4ec8-a89b-25259141fb55 req-37a144cf-2c63-417f-bc84-613f46b1d3e8 service nova] Enqueued Resource ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a with Priority: HIGHEST for action port [ 1303.681500] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_rules [ 1303.681629] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1303.681724] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a with Priority: HIGHEST for action port [ 1303.682279] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.682402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.682503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.682666] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.682749] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.684457] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.684578] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.684646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.684827] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.684982] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.685189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.685254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.685409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.685528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.685586] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.688010] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.688010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.688010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.688010] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.688010] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.185066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.185394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.188601] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.189476] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a with status ACTIVE [ 1304.190155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.190155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.190155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.190155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.190155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.190471] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.190471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.190471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.190581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.190683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.190910] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.191039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.191039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.191154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.191214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.191327] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a is going to be updated. [ 1304.210604] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.210736] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.210798] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.210985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.211132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.211287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ed57c08-92d6-4f7f-bd2c-e991f59ffd0a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.499390] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: SUCCESS [ 1304.499564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.499709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.499911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.500104] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.500221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.500275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.500421] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.500505] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.500587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.500674] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.693306] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.002328] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.002515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.002569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.002900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.003581] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.003581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.003581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.003581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.003875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.003935] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.004242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.004339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.004454] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.004683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.004884] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.005047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.005176] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.005384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.005473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.005594] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.005695] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.195280] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.195685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.195685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.195685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.195805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.195875] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be updated. [ 1305.225081] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.225246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.225305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.225509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.225651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.233586] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: IN_PROGRESS for 2s [ 1305.507939] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8420bd-ff5b-46bf-9912-8f61665f7b94: rpc.has_security_group_logging(os_id): False [ 1305.528625] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.528759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.528835] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.529100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.529140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.529362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.529465] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.529529] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.529677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.529755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.529928] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.530033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.530091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.530241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.530320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.530497] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.530588] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.530649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.530786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.530860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.530945] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be created. [ 1305.589757] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.589907] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.589952] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.590168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.590378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.601888] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: IN_PROGRESS for 2s [ 1307.243858] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: SUCCESS [ 1307.244279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.244279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.244433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.244619] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.244735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.244801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.244962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.245059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.245150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.245239] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.614023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: SUCCESS [ 1307.614275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.747433] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.250191] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f5421a-1862-4f08-954d-478178c2eacc: rpc.has_security_group_logging(os_id): False [ 1308.267384] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.267536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.267579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.267774] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.267866] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.268106] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.268212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.268280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.268446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.268525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.268612] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be updated. [ 1308.344060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.344060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.344060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.344060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.344060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.355305] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: IN_PROGRESS for 2s [ 1308.682510] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.682736] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1309.367934] env[68828]: INFO networking_nsxv3.common.synchronization [req-4e8167de-ffc1-4e0d-8ac0-2a6ff40cc402 req-71576803-e4cd-4aa1-aa3d-905acac1f020 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1309.368800] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGHEST for action security_group_members [ 1309.369198] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.369198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.369360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.369575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.369761] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.370068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.370068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.370239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.370342] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.370451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.414163] env[68828]: INFO networking_nsxv3.common.synchronization [req-4e8167de-ffc1-4e0d-8ac0-2a6ff40cc402 req-71576803-e4cd-4aa1-aa3d-905acac1f020 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: 93406906-c170-4412-848a-499e8094549d with Priority: HIGHEST for action port [ 1309.414626] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93406906-c170-4412-848a-499e8094549d with Priority: HIGHEST for action port [ 1309.414930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-93406906-c170-4412-848a-499e8094549d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.415064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.415130] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.415327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.415406] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93406906-c170-4412-848a-499e8094549d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.872717] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.872976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.873100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.873364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.873449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.873676] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.873787] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.873852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.874018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.874102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.874196] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be updated. [ 1309.903603] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.903758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.903805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.903994] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.904144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.913289] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: IN_PROGRESS for 2s [ 1309.921256] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93406906-c170-4412-848a-499e8094549d with status ACTIVE [ 1309.921469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.921596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.921668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.921850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.921936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.922143] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.922246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.922329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.922503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.922587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.922768] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.922862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.922924] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.923074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.923149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.923233] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93406906-c170-4412-848a-499e8094549d is going to be updated. [ 1309.943055] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.943214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.943368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.943559] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.943685] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.943841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93406906-c170-4412-848a-499e8094549d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.369032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: SUCCESS [ 1310.369360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.923488] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 in Status: SUCCESS [ 1311.923785] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 deletion is rescheduled due to dependency. [ 1311.923859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.415654] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.416077] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.434738] env[68828]: INFO networking_nsxv3.common.synchronization [req-a5fc759d-cb78-4cd4-ad8f-887dd81e57bd req-c5a48016-c2a3-4bbe-910b-eb5b2e5e3369 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_members [ 1317.435730] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGHEST for action security_group_members [ 1317.435730] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.435730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.436272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.436272] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.436388] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.436577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.436720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.436875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.437011] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.437152] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.940037] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.940037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.940037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.940316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.960844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.961132] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.961290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.961383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.961602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.961717] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.961832] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 is going to be updated. [ 1317.985900] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.986102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.986102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.986350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.986537] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.993575] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 in Status: IN_PROGRESS for 2s [ 1320.004338] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 in Status: SUCCESS [ 1320.004721] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 deletion is rescheduled due to dependency. [ 1320.004721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.436426] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.436762] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.437971] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.437971] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.439056] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.439056] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.593564] env[68828]: INFO networking_nsxv3.common.synchronization [req-0fb9c069-a199-4a94-a9fa-23d708c54ccb req-cdbe9a72-ef98-4ef1-bba8-25622f8112a2 tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1332.593827] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1332.594147] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.594271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.594339] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.594544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.594894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.594894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.594894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.595041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.595193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.595298] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.823925] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.824139] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.824274] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.824569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.824837] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.825283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.825283] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.825583] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.825643] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.825852] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1332.825969] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1332.826099] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1332.826216] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1332.826332] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1332.826442] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1332.826579] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1332.846252] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1332.846473] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1332.847071] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1332.847071] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-399" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.847602] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-65a4cc14-5f8e-47e3-b445-cde05d3e8789 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.847602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.847731] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.848065] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.848263] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a4cc14-5f8e-47e3-b445-cde05d3e8789',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.097078] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.350941] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.351279] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.351447] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.351865] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.352177] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.352354] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 65a4cc14-5f8e-47e3-b445-cde05d3e8789 not found, creating... [ 1333.352753] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.352994] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.353203] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.353483] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.353691] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.354104] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.354290] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.354416] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.354659] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.354862] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.355041] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 65a4cc14-5f8e-47e3-b445-cde05d3e8789 is going to be created. [ 1333.375515] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.375713] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.375842] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.376119] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.376349] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.376642] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.599740] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.047924] env[68828]: INFO networking_nsxv3.common.synchronization [req-0fb9c069-a199-4a94-a9fa-23d708c54ccb req-c4d405a1-8215-41de-b68e-063a42380a62 service nova] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1334.048117] env[68828]: INFO networking_nsxv3.common.synchronization [req-0fb9c069-a199-4a94-a9fa-23d708c54ccb req-c4d405a1-8215-41de-b68e-063a42380a62 service nova] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1334.048265] env[68828]: INFO networking_nsxv3.common.synchronization [req-0fb9c069-a199-4a94-a9fa-23d708c54ccb req-c4d405a1-8215-41de-b68e-063a42380a62 service nova] Enqueued Resource ID: 65a4cc14-5f8e-47e3-b445-cde05d3e8789 with Priority: HIGHEST for action port [ 1334.048495] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_rules [ 1334.048668] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1334.048738] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a4cc14-5f8e-47e3-b445-cde05d3e8789 with Priority: HIGHEST for action port [ 1334.049254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.049384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.049452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.049654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.049724] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.050515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.050646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.050802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-65a4cc14-5f8e-47e3-b445-cde05d3e8789 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.050931] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.051040] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.051144] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.051214] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a4cc14-5f8e-47e3-b445-cde05d3e8789',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.102012] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.102210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.102259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.102445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.102538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.102638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be updated. [ 1334.131110] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.131274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.131337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.132023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.132023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.139304] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1334.553336] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.553450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.554791] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65a4cc14-5f8e-47e3-b445-cde05d3e8789 with status ACTIVE [ 1334.554972] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.555172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.555239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.555444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.555581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.555695] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.555800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.555849] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.555997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.556088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.556272] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.556357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.556418] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.556748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.556748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.556748] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65a4cc14-5f8e-47e3-b445-cde05d3e8789 is going to be updated. [ 1334.574832] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.575024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.575024] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.575210] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.575336] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.575487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65a4cc14-5f8e-47e3-b445-cde05d3e8789" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.148574] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1336.149052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.149139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.149376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.149582] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.149763] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.149906] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.150079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.150217] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.150385] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.653311] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.157580] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.659946] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.660256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.660256] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.660535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.660643] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.660755] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be updated. [ 1337.689076] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.689076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.689076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.689076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.689076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.698320] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1339.049575] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1339.050160] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1339.709083] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 4s [ 1341.720880] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1341.721267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.721307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.721546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.721761] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.721918] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.722196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.722196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.722327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.722410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.722519] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.224885] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.727391] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb041b18-87bc-4915-afe4-a638542c6e17: rpc.has_security_group_logging(os_id): False [ 1342.749018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.749229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.749229] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.749449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.749542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.749794] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.749909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.749982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.750211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.750296] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.750388] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be updated. [ 1342.821925] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.822189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.822189] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.822413] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.822809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.839528] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1344.051070] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.051436] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1344.853752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1344.853940] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.052031] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.052333] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.924245] env[68828]: INFO networking_nsxv3.common.synchronization [req-8f2e3d80-ea61-4ab6-b036-e405ccf2ce38 req-53c5931a-68be-4728-96ad-e64ab98d4c0b tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1350.925016] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1350.925605] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.925779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.925871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.926155] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.926375] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.926525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.926616] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.926838] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.926960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.927102] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.432026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.432026] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.432026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.432026] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1351.459032] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.459032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.459032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.459032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.459032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.468020] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1353.480376] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1353.480376] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 deletion is rescheduled due to dependency. [ 1353.480376] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.925950] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.926340] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.923379] env[68828]: INFO networking_nsxv3.common.synchronization [req-a7451089-1f56-45c1-901e-02e0b7063f28 req-1a70a9a0-f126-4094-ac2d-6ec4d594e469 tempest-AttachVolumeShelveTestJSON-1659494353 tempest-AttachVolumeShelveTestJSON-1659494353-project-member] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1357.923379] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGHEST for action security_group_members [ 1357.923602] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.923602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.923602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.923809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.924436] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.924436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.924436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.924436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.924696] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.924696] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.426800] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.427023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.427023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.427236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.427329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.427544] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.427668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.427731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.427892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.427968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.428067] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be updated. [ 1358.454904] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.455096] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.455154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.455329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.455459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.463746] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: IN_PROGRESS for 2s [ 1359.247997] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.248340] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.248340] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.248625] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.248904] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.249095] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.249221] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.249457] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.249607] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.249815] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1359.249936] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1359.250085] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1359.250221] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1359.250341] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1359.250453] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1359.250589] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1359.272494] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1359.272681] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1359.272836] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1359.273070] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-258" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.273393] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.273569] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.273694] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.273969] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.274131] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4916eb52-f3fa-46d2-8b60-d7ca265ad34e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.776740] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.777051] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.777126] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.777560] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.777710] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.778079] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.778258] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.778409] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.778621] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.778743] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.779459] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.779459] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.779459] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.779665] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.779665] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.779812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e is going to be updated. [ 1359.799821] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.799976] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.800137] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.800485] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.800697] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.800929] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.472888] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f5421a-1862-4f08-954d-478178c2eacc in Status: SUCCESS [ 1360.473318] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f5421a-1862-4f08-954d-478178c2eacc deletion is rescheduled due to dependency. [ 1360.473318] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.578111] env[68828]: INFO networking_nsxv3.common.synchronization [req-3fb67ec6-adc5-4c49-ae64-64cab5c6ee51 req-bd18dafb-6aff-438b-8564-8a05fd32dadc service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1360.578286] env[68828]: INFO networking_nsxv3.common.synchronization [req-3fb67ec6-adc5-4c49-ae64-64cab5c6ee51 req-bd18dafb-6aff-438b-8564-8a05fd32dadc service nova] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1360.578414] env[68828]: INFO networking_nsxv3.common.synchronization [req-3fb67ec6-adc5-4c49-ae64-64cab5c6ee51 req-bd18dafb-6aff-438b-8564-8a05fd32dadc service nova] Enqueued Resource ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e with Priority: HIGHEST for action port [ 1360.578640] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_rules [ 1360.578787] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1360.578893] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e with Priority: HIGHEST for action port [ 1360.579445] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.579575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.579645] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.579844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.579928] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.580735] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.580845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.580915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.581087] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.581234] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.581326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.581392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.581521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.581634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.581766] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.582368] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.582472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.582535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.582683] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.582756] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4916eb52-f3fa-46d2-8b60-d7ca265ad34e',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.084815] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.084973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.085152] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.086019] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4916eb52-f3fa-46d2-8b60-d7ca265ad34e with status ACTIVE [ 1361.086221] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.086334] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.086402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.086604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.086692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.086856] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.086971] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.087146] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.087192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.087241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.087412] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.087498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.087549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.087699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.087795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.087914] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4916eb52-f3fa-46d2-8b60-d7ca265ad34e is going to be updated. [ 1361.106246] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.106422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.106466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.106654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.106782] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.106953] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4916eb52-f3fa-46d2-8b60-d7ca265ad34e" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.590310] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.795543] env[68828]: INFO networking_nsxv3.common.synchronization [req-b629946e-8ed5-4fe7-8a58-0e0cf0a5d1da req-080e40c4-11cf-43dd-b331-8a470acd256d tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1361.796313] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1361.796476] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.796595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.796595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.796842] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.796979] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.797156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.797205] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.797363] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.797573] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.797573] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.092435] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.092600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.092659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.092876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.092968] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.093077] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1362.117689] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.117990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.118412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.118412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.118493] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.126632] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1362.143835] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.144045] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.144180] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.144453] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.144713] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.144873] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.144999] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.145234] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.145501] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.145825] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1362.145986] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1362.146125] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1362.146243] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1362.146362] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1362.146474] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1362.146612] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1362.163142] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1362.163297] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1362.163439] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1362.163607] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.163931] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.164114] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.164241] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.164532] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.164677] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fd5a10-efe3-48a7-9b22-08da8ff3f00a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.302819] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.303041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.303041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.303262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.303351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.303552] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.303651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.303714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.303859] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.303936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.304032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1362.328007] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.328167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.328226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.328399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.328535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.336622] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1362.666850] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.667214] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.667263] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.667544] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.667697] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.667888] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 04fd5a10-efe3-48a7-9b22-08da8ff3f00a not found, creating... [ 1362.668183] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.668350] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.668473] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.668695] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.668841] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.669141] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.669304] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.669428] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.669641] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.669781] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.669983] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 04fd5a10-efe3-48a7-9b22-08da8ff3f00a is going to be created. [ 1362.688701] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.688894] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.688996] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.689235] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.689452] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.689667] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.379146] env[68828]: INFO networking_nsxv3.common.synchronization [req-b629946e-8ed5-4fe7-8a58-0e0cf0a5d1da req-e969c73f-6f63-4986-a292-d661e4c099f3 service nova] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1363.379342] env[68828]: INFO networking_nsxv3.common.synchronization [req-b629946e-8ed5-4fe7-8a58-0e0cf0a5d1da req-e969c73f-6f63-4986-a292-d661e4c099f3 service nova] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1363.379488] env[68828]: INFO networking_nsxv3.common.synchronization [req-b629946e-8ed5-4fe7-8a58-0e0cf0a5d1da req-e969c73f-6f63-4986-a292-d661e4c099f3 service nova] Enqueued Resource ID: 04fd5a10-efe3-48a7-9b22-08da8ff3f00a with Priority: HIGHEST for action port [ 1363.379711] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1363.379928] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1363.379928] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04fd5a10-efe3-48a7-9b22-08da8ff3f00a with Priority: HIGHEST for action port [ 1363.380479] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.380613] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.380681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.380900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.380985] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.384411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.384510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.384711] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.384811] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.384877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.385068] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.385295] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04fd5a10-efe3-48a7-9b22-08da8ff3f00a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.887217] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.887489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.887564] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04fd5a10-efe3-48a7-9b22-08da8ff3f00a with status ACTIVE [ 1363.887725] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.887889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.888044] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.888278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.888375] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.888562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.888665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.888720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.889037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.889108] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.889326] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.889461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.889525] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.889640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.889922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.889922] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04fd5a10-efe3-48a7-9b22-08da8ff3f00a is going to be updated. [ 1363.909243] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.909449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.909490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.909714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.909861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.910133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04fd5a10-efe3-48a7-9b22-08da8ff3f00a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.136429] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1364.136644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.136805] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.137070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.137268] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.137387] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.137455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.137608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.137690] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.137779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.137895] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.345812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1364.346110] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 deletion is rescheduled due to dependency. [ 1364.346238] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.346394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.346614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.346801] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.346944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.346988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.347123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.347203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.347300] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.641082] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.849521] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.143010] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27a4adfb-8bb8-4644-a926-1d5f3c8693cd: rpc.has_security_group_logging(os_id): False [ 1365.159927] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.160174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.160174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.160856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.160856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.160856] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.160856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.161097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.161097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.161180] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.161552] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1365.217021] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.217021] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.217223] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.217309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.217491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.230283] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1365.351847] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.854637] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.854853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.854853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.855111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.855211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.855316] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1365.888860] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.889103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.889103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.889311] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.889455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.900018] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1367.243175] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1367.243572] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.909824] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1367.910060] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.910259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.910475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.910666] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.910779] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.910850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.910986] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.911089] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.911158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.911251] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.380615] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.380947] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1368.413227] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.918757] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3199ec-0e4d-4ae9-8c43-76701bbf9090: rpc.has_security_group_logging(os_id): False [ 1368.935898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.935898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.935898] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.936303] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.936446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.936829] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.936913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.936958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.937143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.937219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.937311] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1368.995721] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.995896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.995981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.996221] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.996368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.006674] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1371.020395] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1371.020883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.381447] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.381447] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.025548] env[68828]: INFO networking_nsxv3.common.synchronization [req-8bdd2ef7-787b-4ff8-b5d9-5c0b585c5aa5 req-2d7e031a-03f3-465f-bf15-4e7f4d09c04f tempest-ServerActionsTestOtherB-1878194226 tempest-ServerActionsTestOtherB-1878194226-project-member] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1377.026106] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGHEST for action security_group_members [ 1377.026412] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.026536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.026602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.026802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.027090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.027090] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.027224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.027333] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.027424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.027526] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.529534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.529721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.529767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.529973] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.530083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.530278] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.530378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.530441] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.530599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.530688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.530775] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be updated. [ 1377.555548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.555706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.555751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.555916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.556057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.563351] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: IN_PROGRESS for 2s [ 1379.574206] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd in Status: SUCCESS [ 1379.574554] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd deletion is rescheduled due to dependency. [ 1379.574554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.027360] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.027735] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.028009] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.028333] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.259227] env[68828]: INFO networking_nsxv3.common.synchronization [None req-33fc9c30-7f65-45b2-8fe7-c1f9d787571c None None] Enqueued Resource ID: 697ff4ee-29d7-4944-90d7-c4f5f060ea69 with Priority: HIGHEST for action port [ 1388.259227] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 697ff4ee-29d7-4944-90d7-c4f5f060ea69 with Priority: HIGHEST for action port [ 1388.259227] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-697ff4ee-29d7-4944-90d7-c4f5f060ea69 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.259227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-697ff4ee-29d7-4944-90d7-c4f5f060ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.259227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-697ff4ee-29d7-4944-90d7-c4f5f060ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.259227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-697ff4ee-29d7-4944-90d7-c4f5f060ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.259227] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('697ff4ee-29d7-4944-90d7-c4f5f060ea69',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.413084] env[68828]: INFO networking_nsxv3.common.synchronization [None req-c07426b4-799c-4de7-b9b0-4a0cd218e758 tempest-ServerActionsV293TestJSON-1170648818 tempest-ServerActionsV293TestJSON-1170648818-project-member] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_rules [ 1388.413621] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_rules [ 1388.414240] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.414382] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.414453] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.414734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.414860] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.483160] env[68828]: INFO networking_nsxv3.common.synchronization [None req-580bd39d-0cf3-4614-a425-74cf5db3e423 tempest-ServerActionsV293TestJSON-1170648818 tempest-ServerActionsV293TestJSON-1170648818-project-member] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_rules [ 1388.483826] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_rules [ 1388.484155] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.484286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.760758] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 697ff4ee-29d7-4944-90d7-c4f5f060ea69 [ 1388.760981] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.761140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.761214] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.761434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.761517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.761611] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:697ff4ee-29d7-4944-90d7-c4f5f060ea69 already deleted. [ 1388.761691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-697ff4ee-29d7-4944-90d7-c4f5f060ea69" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.934898] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.935074] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.935337] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.935409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.935450] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.935539] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 already deleted. [ 1388.935623] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.935765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.935917] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.935999] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.454253] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.454473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.454473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.455372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.455372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.455372] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 already deleted. [ 1389.455372] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.397241] env[68828]: INFO networking_nsxv3.common.synchronization [None req-b297d2fa-2114-4c4a-b5bc-46cfbde1fc0b None None] Enqueued Resource ID: f904047e-44cf-4fcc-86ad-af957c5225ab with Priority: HIGHEST for action port [ 1390.397536] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f904047e-44cf-4fcc-86ad-af957c5225ab with Priority: HIGHEST for action port [ 1390.398242] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-f904047e-44cf-4fcc-86ad-af957c5225ab taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.398426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f904047e-44cf-4fcc-86ad-af957c5225ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.398501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f904047e-44cf-4fcc-86ad-af957c5225ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.398758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f904047e-44cf-4fcc-86ad-af957c5225ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.398949] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f904047e-44cf-4fcc-86ad-af957c5225ab',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.902230] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f904047e-44cf-4fcc-86ad-af957c5225ab [ 1390.902524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.902603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.902675] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.902890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.902983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.903113] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f904047e-44cf-4fcc-86ad-af957c5225ab already deleted. [ 1390.903192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f904047e-44cf-4fcc-86ad-af957c5225ab" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.398238] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.398535] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.399047] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.399368] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.399968] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.400399] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.897458] env[68828]: INFO networking_nsxv3.common.synchronization [req-657aded2-c17f-442e-bd34-7137660591fe req-5a06e09a-efbf-40c8-a79f-dab5d95c7a2a tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1406.900142] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1406.900142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.900142] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.900142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.900142] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.401680] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.903954] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.406293] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.406511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.406511] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.406706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.406800] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.406897] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be updated. [ 1408.433992] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.434185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.434185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.434368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.434515] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.441804] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1410.453090] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1410.453488] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.701638] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd6d86c8-61ec-4a94-93aa-542fba9fc464 req-f1c3bcc9-17cb-487d-88e2-075ba3fc997b tempest-ServerActionsV293TestJSON-1170648818 tempest-ServerActionsV293TestJSON-1170648818-project-member] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_members [ 1411.702189] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_members [ 1411.702490] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.702609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.702695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.702928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.703107] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.703224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.703292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.703419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.703491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.703628] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.954899] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.955113] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-912" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.955245] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-912" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.955870] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-912" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.956231] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.956429] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.956558] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.956788] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.956936] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.957175] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1411.957296] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1411.957412] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1411.957527] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1411.957669] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1411.957801] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1411.958197] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1411.975962] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1411.976144] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1411.976285] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1411.976456] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-912" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.976736] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.976900] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.977041] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.977338] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.977482] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af65370-f1bd-4e8b-96b9-2a7a9f0f2683',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.206178] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.206392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.206460] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.206653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.206745] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.206941] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.207052] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.207115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.207255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.207331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.207419] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 already deleted. [ 1412.207491] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.479606] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.479909] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.480081] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.480527] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.480740] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.480934] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 not found, creating... [ 1412.481268] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.481463] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.481616] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.481882] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.482074] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.482422] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.482602] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.482766] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.484053] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.484053] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.484053] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 is going to be created. [ 1412.502247] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.502493] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.502573] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.502856] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.503138] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.503387] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.190432] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd6d86c8-61ec-4a94-93aa-542fba9fc464 req-8a290e20-f6fd-41b1-ae73-fe6b884fa5ac service nova] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_rules [ 1413.190771] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd6d86c8-61ec-4a94-93aa-542fba9fc464 req-8a290e20-f6fd-41b1-ae73-fe6b884fa5ac service nova] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_members [ 1413.190831] env[68828]: INFO networking_nsxv3.common.synchronization [req-fd6d86c8-61ec-4a94-93aa-542fba9fc464 req-8a290e20-f6fd-41b1-ae73-fe6b884fa5ac service nova] Enqueued Resource ID: 3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 with Priority: HIGHEST for action port [ 1413.191018] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_rules [ 1413.191149] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_members [ 1413.191245] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 with Priority: HIGHEST for action port [ 1413.191842] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.191925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.192051] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.192364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.192455] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.193411] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.193411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.194085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.194085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.194085] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.194085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.194085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.194085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.194085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.194526] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.198398] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.198398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.198398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.198398] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.198398] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af65370-f1bd-4e8b-96b9-2a7a9f0f2683',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.697391] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.697567] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.698992] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.699952] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 with status ACTIVE [ 1413.700180] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.700302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.700369] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.700580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.700688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.700878] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.700980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.701063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.701230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.701305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.701486] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.701581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.701639] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.701772] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.701845] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.701957] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3af65370-f1bd-4e8b-96b9-2a7a9f0f2683 is going to be updated. [ 1413.721524] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.721658] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.721723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.721902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.722050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.722201] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3af65370-f1bd-4e8b-96b9-2a7a9f0f2683" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.203880] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.708785] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.708933] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.708979] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.709213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.709309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.709450] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 is going to be created. [ 1414.731466] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.731607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.731677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.731896] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.732049] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.740034] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 in Status: UNINITIALIZED for 2s [ 1416.751517] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 in Status: SUCCESS [ 1416.751878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.751878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.752072] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.752272] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.752393] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.752463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.752622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.752703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.752792] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.752882] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.255469] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.757820] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 788073c9-e36d-474e-8ff7-82a89a4e8112: rpc.has_security_group_logging(os_id): False [ 1417.779829] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.780046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.780046] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.780244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.780335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.780590] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.780721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.780778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.780915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.780996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.781087] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 is going to be created. [ 1417.837400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.837510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.837599] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.837802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.837982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.850037] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 in Status: IN_PROGRESS for 2s [ 1418.192515] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.192627] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1419.863429] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 in Status: SUCCESS [ 1419.863784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.193722] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.194117] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.574642] env[68828]: INFO networking_nsxv3.common.synchronization [req-ce874743-ef84-463c-9ec4-f840db8c1e48 req-2f9ef64a-6f7c-43f2-a4a6-4ce3ed9dfb6f tempest-ServerActionsTestOtherA-556675829 tempest-ServerActionsTestOtherA-556675829-project-member] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1426.575168] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGHEST for action security_group_members [ 1426.575468] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.575605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.576753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.576753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.576753] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.576753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.576753] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.577063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.577063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.577063] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.080066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.080066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.080066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.080499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.080499] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.080697] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.080816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.080884] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.081027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.081105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.081194] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be updated. [ 1427.107740] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.107960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.107960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.108164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.108304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.116267] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: IN_PROGRESS for 2s [ 1429.126119] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb041b18-87bc-4915-afe4-a638542c6e17 in Status: SUCCESS [ 1429.126455] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 deletion is rescheduled due to dependency. [ 1429.126455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.576630] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.576961] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.577689] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.577874] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.579229] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.579229] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.217865] env[68828]: INFO networking_nsxv3.common.synchronization [req-2266b2e1-38a9-428a-a83b-5e9abe497b89 req-937f032f-6e3f-4467-8dd8-ca398e89fe4c tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1444.218408] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1444.219027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.219027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.219027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.219305] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.219433] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.219512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.219512] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.219699] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.219786] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.219882] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.721955] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.722185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.722264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.722489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.722583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.722792] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.722892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.722955] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.723115] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.723193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.723281] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1444.750953] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.751140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.751251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.751519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.751730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.760251] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1446.771143] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1446.771492] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 deletion is rescheduled due to dependency. [ 1446.771492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.219414] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.219736] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.169762] env[68828]: INFO networking_nsxv3.common.synchronization [req-cf916b8f-8909-446f-8d69-b3af4c4c8014 req-36235645-6793-4e5f-b5f8-9908ebd7904d tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1453.170622] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1453.171090] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.171271] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.171378] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.171983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.171983] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.172123] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.172216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.172464] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.172608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.172761] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.425996] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.426234] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.426362] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.426643] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.426904] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.427076] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.427199] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.427420] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.427567] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.428017] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1453.428160] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1453.428279] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1453.428393] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1453.428511] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1453.428623] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1453.429172] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1453.451015] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1453.451208] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1453.451353] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1453.451529] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-139" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.451842] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.452028] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.452157] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.452505] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.452661] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1453.675061] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.675300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.675300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.675471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.675561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.675758] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.675857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.675915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.676081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.676154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.676239] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1453.706112] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.706306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.706306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.706463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.706597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.715434] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1453.955289] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.955594] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.955729] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.956032] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.956182] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.956343] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 not found, creating... [ 1453.956611] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.956772] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.956896] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.957134] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.957278] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.957557] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.957717] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.957840] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.958071] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.958214] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.958357] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 is going to be created. [ 1453.978301] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.978479] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.978576] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.978828] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.979061] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.979287] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.636657] env[68828]: INFO networking_nsxv3.common.synchronization [req-cf916b8f-8909-446f-8d69-b3af4c4c8014 req-31b686c3-fffb-44df-9b51-3d6ae673ead0 service nova] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1454.636939] env[68828]: INFO networking_nsxv3.common.synchronization [req-cf916b8f-8909-446f-8d69-b3af4c4c8014 req-31b686c3-fffb-44df-9b51-3d6ae673ead0 service nova] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1454.637076] env[68828]: INFO networking_nsxv3.common.synchronization [req-cf916b8f-8909-446f-8d69-b3af4c4c8014 req-31b686c3-fffb-44df-9b51-3d6ae673ead0 service nova] Enqueued Resource ID: 022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 with Priority: HIGHEST for action port [ 1454.637528] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_rules [ 1454.637660] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1454.637758] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 with Priority: HIGHEST for action port [ 1454.638171] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.638346] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.638455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.638691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.639233] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.639837] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.639965] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.640224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.640371] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.640496] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.640710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.640831] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.142722] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.142900] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.143424] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 with status ACTIVE [ 1455.143424] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.143424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.143626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.143781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.143904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.144151] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.144315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.144405] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.144593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.144701] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.144916] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.145056] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.145145] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.145313] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.145416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.145520] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9 is going to be updated. [ 1455.166517] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.166692] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.166810] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.167039] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.167208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.167392] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-022f6d19-c4e0-4f89-b8e5-1e8c0ba216f9" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.723560] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1455.723926] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 deletion is rescheduled due to dependency. [ 1455.723926] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.724069] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.724419] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.724419] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.724610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.724610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.724709] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.724759] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.724816] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.227256] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.728931] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.231168] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.231329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.231329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.231542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.231612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.231758] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1457.259169] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.259446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.259446] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.259633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.259730] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.267567] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1459.278570] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1459.278914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.278958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.279173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.279354] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.279463] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.279528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.279677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.279756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.279839] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.279929] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.639142] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.639317] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1459.781889] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.284414] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3199ec-0e4d-4ae9-8c43-76701bbf9090: rpc.has_security_group_logging(os_id): False [ 1460.301831] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.302112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.302112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.302344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.302400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.302634] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.302734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.302819] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.302988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.303081] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.303169] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1460.360805] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.361057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.361057] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.361267] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.361412] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.372924] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1462.387877] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1462.388261] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.640035] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.640492] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.987233] env[68828]: INFO networking_nsxv3.common.synchronization [req-4363e81b-f80f-4647-bac0-f301844ab4ed req-acfbfbc2-8030-4ffc-a15e-9adcb8132f50 tempest-ServerActionsV293TestJSON-1170648818 tempest-ServerActionsV293TestJSON-1170648818-project-member] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_members [ 1466.987233] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGHEST for action security_group_members [ 1466.987476] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.989943] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.989943] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.989943] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.490498] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.490653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.490752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.490946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.491071] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.491276] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.491538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.491538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.491659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.491659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.491752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 is going to be updated. [ 1467.517736] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.517878] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.517919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.518116] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.518252] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.528101] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 in Status: IN_PROGRESS for 2s [ 1469.539317] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 in Status: SUCCESS [ 1469.539652] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 deletion is rescheduled due to dependency. [ 1469.539652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.988106] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.988462] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.988973] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.989399] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.990576] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.990576] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.991444] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.991444] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.992705] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.993150] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.911731] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1493.912150] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1496.994260] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.994632] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.995404] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.995827] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.852491] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.852758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.852758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.852932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.853058] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.355714] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.858512] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.360827] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1506.360929] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1506.996880] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.997289] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.227028] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.227307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.227307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.227549] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.241085] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1507.242023] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.242817] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1507.281403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.281652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.281652] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.281855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.296806] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.297655] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1507.297790] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1507.297845] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1507.335315] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.335528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.335577] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.335775] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.336570] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.336824] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1507.404907] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.405149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.405149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.405329] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.405636] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.405908] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1507.476469] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.476626] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.476706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.476915] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.477294] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.477611] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:25. [ 1507.477710] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2a8420bd-ff5b-46bf-9912-8f61665f7b94', '14ffdab8-bf16-471f-9412-c5026034844d', '55fbd6f6-2090-4d92-ac03-c7ce1819a7d1', '49bff80d-9c54-4a44-a1a9-f388114a1a64', '27a4adfb-8bb8-4644-a926-1d5f3c8693cd', 'df1d5f70-a74c-42f7-ac16-3a22419f5e48', '17f5421a-1862-4f08-954d-478178c2eacc', '2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a', '7f3199ec-0e4d-4ae9-8c43-76701bbf9090', '6547eb98-d904-4822-951d-00fe16de337d', '788073c9-e36d-474e-8ff7-82a89a4e8112', 'f9050286-eb81-4cbb-9bd8-733baee0e20c', 'cb041b18-87bc-4915-afe4-a638542c6e17', 'e6a0522b-dbc3-42bf-8801-b6e755596373', '7c70394b-e7ce-40e9-946e-b190f72998f8', 'd681bb4b-ff28-46df-b3fb-b660a07ce6c2', '4dd0ece4-c4cb-4634-93e2-7a904a6189e5', '37ec0117-a289-428f-9466-58f2541a90c7', '448a7f6d-e5f6-4ab8-9c7c-330542177864', 'ee881f3c-d61c-4373-931c-252d84c5ac2b', '33e63aa4-edf9-4cdd-b540-1791bfdc42d4', '0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff', 'a40c3045-d4de-46b9-862d-aaeccc547265', 'e9f41e17-e083-4115-b3db-6fcd432d4982', '4ccb4815-10bb-46a0-9b26-0a53fb6c8347'} {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1507.477810] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1507.494640] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.494778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.494874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.495078] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.495165] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.495269] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1507.495342] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1507.495411] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1507.576803] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.576988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.577059] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.577280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.578449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.578731] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1507.578827] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1507.578907] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1507.578976] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1507.579067] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/25 resources of Type:Security Group Rules [ 1507.579141] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGH for action security_group_rules [ 1507.579214] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGH for action security_group_rules [ 1507.579317] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGH for action security_group_rules [ 1507.579402] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGH for action security_group_rules [ 1507.579458] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGH for action security_group_rules [ 1507.579513] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGH for action security_group_rules [ 1507.579576] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGH for action security_group_rules [ 1507.579630] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGH for action security_group_rules [ 1507.579684] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGH for action security_group_rules [ 1507.579721] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGH for action security_group_rules [ 1507.579806] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGH for action security_group_rules [ 1507.579862] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGH for action security_group_rules [ 1507.579915] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGH for action security_group_rules [ 1507.579963] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGH for action security_group_rules [ 1507.580022] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGH for action security_group_rules [ 1507.580085] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGH for action security_group_rules [ 1507.580134] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGH for action security_group_rules [ 1507.580182] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGH for action security_group_rules [ 1507.580231] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGH for action security_group_rules [ 1507.580283] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGH for action security_group_rules [ 1507.580380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.997951] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.998217] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1511.998217] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 with Priority: HIGH for action security_group_rules [ 1511.998331] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 with Priority: HIGH for action security_group_rules [ 1511.998452] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f5421a-1862-4f08-954d-478178c2eacc with Priority: HIGH for action security_group_rules [ 1511.998575] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 with Priority: HIGH for action security_group_rules [ 1511.998710] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee881f3c-d61c-4373-931c-252d84c5ac2b with Priority: HIGH for action security_group_rules [ 1511.998847] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 with Priority: HIGH for action security_group_rules [ 1511.998954] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ec0117-a289-428f-9466-58f2541a90c7 with Priority: HIGH for action security_group_rules [ 1511.999131] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 with Priority: HIGH for action security_group_rules [ 1511.999247] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a0522b-dbc3-42bf-8801-b6e755596373 with Priority: HIGH for action security_group_rules [ 1511.999416] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 with Priority: HIGH for action security_group_rules [ 1511.999536] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb041b18-87bc-4915-afe4-a638542c6e17 with Priority: HIGH for action security_group_rules [ 1511.999680] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9050286-eb81-4cbb-9bd8-733baee0e20c with Priority: HIGH for action security_group_rules [ 1511.999800] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 with Priority: HIGH for action security_group_rules [ 1511.999893] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6547eb98-d904-4822-951d-00fe16de337d with Priority: HIGH for action security_group_rules [ 1512.000043] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGH for action security_group_rules [ 1512.000163] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 with Priority: HIGH for action security_group_rules [ 1512.000319] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a with Priority: HIGH for action security_group_rules [ 1512.000454] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd with Priority: HIGH for action security_group_rules [ 1512.000582] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffdab8-bf16-471f-9412-c5026034844d with Priority: HIGH for action security_group_rules [ 1512.000706] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 with Priority: HIGH for action security_group_rules [ 1512.001062] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.001196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.001279] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.001468] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.001552] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8420bd-ff5b-46bf-9912-8f61665f7b94',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.002731] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.002854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.002932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.003100] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.003239] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55fbd6f6-2090-4d92-ac03-c7ce1819a7d1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.003927] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f5421a-1862-4f08-954d-478178c2eacc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.004047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.004111] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.004257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.004330] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f5421a-1862-4f08-954d-478178c2eacc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.005034] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c70394b-e7ce-40e9-946e-b190f72998f8 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.005167] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.005285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.005423] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.005511] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c70394b-e7ce-40e9-946e-b190f72998f8',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.006362] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee881f3c-d61c-4373-931c-252d84c5ac2b taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.006501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.006501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.006713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.006801] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee881f3c-d61c-4373-931c-252d84c5ac2b',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.007548] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-448a7f6d-e5f6-4ab8-9c7c-330542177864 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.007857] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.007988] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.008192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.008298] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('448a7f6d-e5f6-4ab8-9c7c-330542177864',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.009199] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37ec0117-a289-428f-9466-58f2541a90c7 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.009364] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.009440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.009597] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.009669] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37ec0117-a289-428f-9466-58f2541a90c7',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.010394] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.010504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.010566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.010734] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.010808] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd0ece4-c4cb-4634-93e2-7a904a6189e5',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.011530] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6a0522b-dbc3-42bf-8801-b6e755596373 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.011642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.011706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.011873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.011947] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6a0522b-dbc3-42bf-8801-b6e755596373',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.014470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.014582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.014646] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.014797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.014866] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d681bb4b-ff28-46df-b3fb-b660a07ce6c2',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.015536] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb041b18-87bc-4915-afe4-a638542c6e17 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.015649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.015855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.015855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.015931] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb041b18-87bc-4915-afe4-a638542c6e17',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.016597] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9050286-eb81-4cbb-9bd8-733baee0e20c taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.016702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.016769] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.016913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.016986] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9050286-eb81-4cbb-9bd8-733baee0e20c',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.017651] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-788073c9-e36d-474e-8ff7-82a89a4e8112 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.017762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.017821] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.017962] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.018041] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('788073c9-e36d-474e-8ff7-82a89a4e8112',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.154104] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6547eb98-d904-4822-951d-00fe16de337d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.154338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.154338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.154507] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.154590] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6547eb98-d904-4822-951d-00fe16de337d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.155449] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.155575] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.155627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.155794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.155922] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.156552] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.156659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.156723] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.156869] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.156942] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df1d5f70-a74c-42f7-ac16-3a22419f5e48',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.157727] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.157856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.157891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.158038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.158112] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.158756] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.158865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.158932] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.159095] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.159167] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27a4adfb-8bb8-4644-a926-1d5f3c8693cd',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.159858] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ffdab8-bf16-471f-9412-c5026034844d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.159960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.160033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.160182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.160254] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ffdab8-bf16-471f-9412-c5026034844d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.160984] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49bff80d-9c54-4a44-a1a9-f388114a1a64 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.161110] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.161171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.161319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.161394] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49bff80d-9c54-4a44-a1a9-f388114a1a64',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.208562] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.208854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.208854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.208957] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.210712] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.210840] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.211551] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.211684] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.212417] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.212514] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.213499] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.213596] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.214296] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.214390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.215080] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.215178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.215855] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.215951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.225383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.225499] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6547eb98-d904-4822-951d-00fe16de337d is going to be deleted. [ 1512.226283] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.226495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.240919] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.241049] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55fbd6f6-2090-4d92-ac03-c7ce1819a7d1 is going to be deleted. [ 1512.241743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.241922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.273082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.273276] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8420bd-ff5b-46bf-9912-8f61665f7b94 is going to be deleted. [ 1512.274174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.274359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.303419] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.303722] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.304498] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.304625] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 448a7f6d-e5f6-4ab8-9c7c-330542177864 is going to be deleted. [ 1512.306052] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.306148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.306211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.306399] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.306484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.306602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6547eb98-d904-4822-951d-00fe16de337d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.306743] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.306892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.325320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.325597] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c70394b-e7ce-40e9-946e-b190f72998f8 is going to be deleted. [ 1512.326379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.326595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.342254] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.342497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.345747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.345904] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49bff80d-9c54-4a44-a1a9-f388114a1a64 is going to be deleted. [ 1512.346793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.347014] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.368470] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.368706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.375415] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.375607] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9050286-eb81-4cbb-9bd8-733baee0e20c is going to be deleted. [ 1512.376485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.376704] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.376793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.376916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55fbd6f6-2090-4d92-ac03-c7ce1819a7d1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.377091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.377254] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.402431] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.402650] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.445817] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.445983] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f5421a-1862-4f08-954d-478178c2eacc is going to be deleted. [ 1512.447268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.447518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.447624] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.447726] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8420bd-ff5b-46bf-9912-8f61665f7b94" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.447890] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.448066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.448148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.448262] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-448a7f6d-e5f6-4ab8-9c7c-330542177864" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.448762] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.448923] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.449018] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.449135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c70394b-e7ce-40e9-946e-b190f72998f8" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.463269] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.463614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.463614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.463886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.463886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.463886] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49bff80d-9c54-4a44-a1a9-f388114a1a64" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.521054] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.521312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.521312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.521516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.521568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.521674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9050286-eb81-4cbb-9bd8-733baee0e20c" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.581883] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.582168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.582168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.582322] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.582416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.582546] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f5421a-1862-4f08-954d-478178c2eacc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.674574] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.674802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.674802] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.675038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.675218] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.675316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.675379] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.675528] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.675603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.675695] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.675781] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.699777] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.699910] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.699949] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.700153] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.701640] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.701746] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.702391] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.702486] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.703202] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.703299] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.704397] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.704500] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.735403] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.735554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.738250] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.738353] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.739100] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.739202] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.746201] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.746326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.752978] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.753126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.754037] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.754149] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ffdab8-bf16-471f-9412-c5026034844d is going to be deleted. [ 1512.755440] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.755536] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.755604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.755773] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.785198] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.785340] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d681bb4b-ff28-46df-b3fb-b660a07ce6c2 is going to be deleted. [ 1512.786079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.786269] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.809543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.809688] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27a4adfb-8bb8-4644-a926-1d5f3c8693cd is going to be deleted. [ 1512.810426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.810611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.828966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.829095] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 788073c9-e36d-474e-8ff7-82a89a4e8112 is going to be deleted. [ 1512.829865] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.830066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.840190] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.840319] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.841106] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.841232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.854516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.854634] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd0ece4-c4cb-4634-93e2-7a904a6189e5 is going to be deleted. [ 1512.855368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.855552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.882461] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.882618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.889390] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.889605] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.890207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.890320] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37ec0117-a289-428f-9466-58f2541a90c7 is going to be deleted. [ 1512.891159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.891351] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.948318] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.948501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.951302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.951421] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6a0522b-dbc3-42bf-8801-b6e755596373 is going to be deleted. [ 1512.952242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.952448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.007492] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.007908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.036914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.037077] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df1d5f70-a74c-42f7-ac16-3a22419f5e48 is going to be deleted. [ 1513.037990] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.038219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.097193] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.097359] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee881f3c-d61c-4373-931c-252d84c5ac2b is going to be deleted. [ 1513.098212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.098424] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.120018] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.120164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.135535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.135752] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a is going to be deleted. [ 1513.136581] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.136791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.159057] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.159314] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.178758] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.178893] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb041b18-87bc-4915-afe4-a638542c6e17 is going to be deleted. [ 1513.179868] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.180694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.181539] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.181669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.181809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d681bb4b-ff28-46df-b3fb-b660a07ce6c2" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.182185] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.182414] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.182521] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.182627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ffdab8-bf16-471f-9412-c5026034844d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.183268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.183316] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.183349] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.183472] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27a4adfb-8bb8-4644-a926-1d5f3c8693cd" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.183614] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.183755] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.183831] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.183939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-788073c9-e36d-474e-8ff7-82a89a4e8112" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.184091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.184227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.184302] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.184445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd0ece4-c4cb-4634-93e2-7a904a6189e5" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.184538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.184720] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.184795] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.184851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37ec0117-a289-428f-9466-58f2541a90c7" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.184972] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.185128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.185199] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.185306] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6a0522b-dbc3-42bf-8801-b6e755596373" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.185434] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.185568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.185637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.185739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df1d5f70-a74c-42f7-ac16-3a22419f5e48" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.223886] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.224055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.224055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.224208] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.224270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.224389] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee881f3c-d61c-4373-931c-252d84c5ac2b" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.284136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.284287] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.284359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.284582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.284674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.284797] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a4b3dc6-9c7a-4107-b194-c9b2ef2d263a" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.386136] env[68828]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1513.386716] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.386844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.386916] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.387143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.387232] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.387354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb041b18-87bc-4915-afe4-a638542c6e17" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.682962] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3199ec-0e4d-4ae9-8c43-76701bbf9090: rpc.has_security_group_logging(os_id): False [ 1513.700060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.700224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.700270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.700612] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.720784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.721038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.721164] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.721231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.721373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.721448] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.721543] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1513.784594] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.784756] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.784801] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.784961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.785109] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.797661] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1515.779961] env[68828]: INFO networking_nsxv3.common.synchronization [req-40f774a3-1fc3-492a-9889-8d91968f2ef6 req-a67350a5-3690-43ef-aef1-ee754528cd58 tempest-ServerActionsTestJSON-1018389342 tempest-ServerActionsTestJSON-1018389342-project-member] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1515.780458] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGHEST for action security_group_members [ 1515.780764] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.780914] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.781099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.781212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.781319] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.781437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.781437] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.781635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.781635] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.781807] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.815267] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1515.815484] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.284179] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.284373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.284427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.284634] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.284794] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.284930] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.285054] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.285098] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.285246] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.285321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.285408] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be updated. [ 1516.311136] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.311289] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.311332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.311475] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.311602] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.321183] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: IN_PROGRESS for 2s [ 1518.331654] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 in Status: SUCCESS [ 1518.332050] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 deletion is rescheduled due to dependency. [ 1518.332050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.781166] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.781554] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.292799] env[68828]: INFO networking_nsxv3.common.synchronization [None req-f958335c-86d8-453c-a338-97dc00b0d980 None None] Enqueued Resource ID: 1783038d-0b90-4065-b1dc-7eab4b9254ad with Priority: HIGHEST for action port [ 1523.293082] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1783038d-0b90-4065-b1dc-7eab4b9254ad with Priority: HIGHEST for action port [ 1523.293652] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-1783038d-0b90-4065-b1dc-7eab4b9254ad taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.293778] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1783038d-0b90-4065-b1dc-7eab4b9254ad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.293848] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1783038d-0b90-4065-b1dc-7eab4b9254ad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.294242] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1783038d-0b90-4065-b1dc-7eab4b9254ad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.294329] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1783038d-0b90-4065-b1dc-7eab4b9254ad',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.796406] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1783038d-0b90-4065-b1dc-7eab4b9254ad [ 1523.796669] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.796790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.796860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.797133] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.797227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.797471] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1783038d-0b90-4065-b1dc-7eab4b9254ad already deleted. [ 1523.797593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1783038d-0b90-4065-b1dc-7eab4b9254ad" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.808591] env[68828]: INFO networking_nsxv3.common.synchronization [None req-2143b5a6-6567-4781-bae0-1fd28803f801 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_rules [ 1523.809273] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_rules [ 1523.809825] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.809825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.809825] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.810020] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.810101] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.876020] env[68828]: INFO networking_nsxv3.common.synchronization [None req-2ea76a74-553c-442e-8b10-e7b53f998558 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_rules [ 1523.876275] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_rules [ 1523.876802] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.876904] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.330167] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.330451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.330451] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.330629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.330712] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.330812] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21328bb-ac07-4420-99ca-d686426c559d already deleted. [ 1524.330892] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.331041] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.331212] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.331272] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.850231] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.850544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.850665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.850880] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.850975] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.851091] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21328bb-ac07-4420-99ca-d686426c559d already deleted. [ 1524.851179] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.305688] env[68828]: INFO networking_nsxv3.common.synchronization [None req-651a2ad5-8e33-4093-921c-a42b50d444c7 None None] Enqueued Resource ID: 86a297a9-6921-4299-b8a3-933fb0d4debb with Priority: HIGHEST for action port [ 1525.305944] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a297a9-6921-4299-b8a3-933fb0d4debb with Priority: HIGHEST for action port [ 1525.306523] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a297a9-6921-4299-b8a3-933fb0d4debb taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.306677] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a297a9-6921-4299-b8a3-933fb0d4debb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.306751] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a297a9-6921-4299-b8a3-933fb0d4debb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.307016] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a297a9-6921-4299-b8a3-933fb0d4debb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.307105] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a297a9-6921-4299-b8a3-933fb0d4debb',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.809054] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86a297a9-6921-4299-b8a3-933fb0d4debb [ 1525.809054] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.809358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.809358] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.809509] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.809627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.809705] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86a297a9-6921-4299-b8a3-933fb0d4debb already deleted. [ 1525.809790] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a297a9-6921-4299-b8a3-933fb0d4debb" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.053300] env[68828]: INFO networking_nsxv3.common.synchronization [req-c2945678-32d3-4911-bec2-133bc2bb742e req-6d64d310-0145-42cc-89a9-f0f3108cc3ec tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_members [ 1529.055813] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_members [ 1529.055813] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.055813] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.055813] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.055813] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.291614] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.291812] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.291944] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.292337] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.292582] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.292747] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.292869] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.293099] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.293249] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.293476] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1529.293605] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1529.293731] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1529.293897] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1529.294072] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1529.294146] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1529.294285] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1529.314640] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1529.314802] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1529.314945] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1529.315133] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.315422] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-d70f2bfb-9600-4c92-ade1-3fde052450b1 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.315590] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.315716] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.316015] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.316164] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d70f2bfb-9600-4c92-ade1-3fde052450b1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.556838] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.556982] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.557033] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.557244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.557338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.557540] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.557642] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.557705] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.557853] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.557930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.558031] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21328bb-ac07-4420-99ca-d686426c559d already deleted. [ 1529.558114] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.818836] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.819051] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.819211] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.819549] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.819720] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.819881] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port d70f2bfb-9600-4c92-ade1-3fde052450b1 not found, creating... [ 1529.820162] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.820328] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.820460] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.820732] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.820882] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.821200] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.821360] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.821485] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.821703] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.821845] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.821991] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: d70f2bfb-9600-4c92-ade1-3fde052450b1 is going to be created. [ 1529.843890] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.844109] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1529.844245] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1529.844554] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1529.844904] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.845181] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.531486] env[68828]: INFO networking_nsxv3.common.synchronization [req-c2945678-32d3-4911-bec2-133bc2bb742e req-702a5f3f-d203-4b19-8cee-4d5a18c190fe service nova] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_rules [ 1530.531788] env[68828]: INFO networking_nsxv3.common.synchronization [req-c2945678-32d3-4911-bec2-133bc2bb742e req-702a5f3f-d203-4b19-8cee-4d5a18c190fe service nova] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_members [ 1530.531821] env[68828]: INFO networking_nsxv3.common.synchronization [req-c2945678-32d3-4911-bec2-133bc2bb742e req-702a5f3f-d203-4b19-8cee-4d5a18c190fe service nova] Enqueued Resource ID: d70f2bfb-9600-4c92-ade1-3fde052450b1 with Priority: HIGHEST for action port [ 1530.532086] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_rules [ 1530.532225] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_members [ 1530.532319] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70f2bfb-9600-4c92-ade1-3fde052450b1 with Priority: HIGHEST for action port [ 1530.532881] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.533047] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.533134] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.533301] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.533383] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.534321] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.534944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.534944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.534944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.534944] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.534944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.534944] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.535148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.535148] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.535201] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.536332] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-d70f2bfb-9600-4c92-ade1-3fde052450b1 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.536332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.536430] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.536554] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.536628] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d70f2bfb-9600-4c92-ade1-3fde052450b1',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.038833] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.040215] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.040368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.040482] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d70f2bfb-9600-4c92-ade1-3fde052450b1 with status ACTIVE [ 1531.041088] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.041088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.041088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.041088] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.041293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.041293] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.041368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.041429] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.041582] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.041661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.041838] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.041928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.041989] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.042140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.042216] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.042300] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d70f2bfb-9600-4c92-ade1-3fde052450b1 is going to be updated. [ 1531.066205] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.066402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1531.066402] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1531.066608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1531.066742] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.066899] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d70f2bfb-9600-4c92-ade1-3fde052450b1" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1531.544933] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.047550] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.047739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.047803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.047981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.048091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.048199] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21328bb-ac07-4420-99ca-d686426c559d is going to be created. [ 1532.071065] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.071286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.071286] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.071476] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.071633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.080248] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21328bb-ac07-4420-99ca-d686426c559d in Status: UNINITIALIZED for 2s [ 1534.089853] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21328bb-ac07-4420-99ca-d686426c559d in Status: SUCCESS [ 1534.090239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.090239] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.090426] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.090648] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.090748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.090816] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.090969] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.091062] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.091150] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.091238] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.593760] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.096023] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a21328bb-ac07-4420-99ca-d686426c559d: rpc.has_security_group_logging(os_id): False [ 1535.112839] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.112997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.112997] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.113219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.113309] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.113544] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.113644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.113707] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.113852] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.113928] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.114026] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21328bb-ac07-4420-99ca-d686426c559d is going to be created. [ 1535.183864] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.184013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.184075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.184266] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.184444] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.193486] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a21328bb-ac07-4420-99ca-d686426c559d in Status: IN_PROGRESS for 2s [ 1535.533402] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.533523] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1537.207105] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a21328bb-ac07-4420-99ca-d686426c559d in Status: SUCCESS [ 1537.207443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.535026] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.535026] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.536187] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.536495] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.537761] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.538116] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.538967] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.539340] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.540414] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.540799] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1565.541940] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.542307] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1570.543266] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1570.543603] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1575.544856] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1575.545165] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1580.546425] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1580.546781] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1585.547699] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1585.548044] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1590.548674] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1590.549044] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.549848] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1595.550224] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1600.551203] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1600.551584] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1605.552211] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1605.552518] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1610.553074] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1610.553403] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1615.554271] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.554271] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.555384] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.555773] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.556555] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.556555] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1630.557927] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.558381] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.559553] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.559944] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.561131] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.561545] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.563058] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.563058] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.564466] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.564891] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.566138] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.566423] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.567283] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.567651] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.568559] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.568879] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.569622] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.569998] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1675.570882] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1675.571185] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1677.709584] env[68828]: INFO networking_nsxv3.common.synchronization [req-cf4f18e0-40af-4003-a359-4c12e1084b3b req-261fed95-a57c-4379-a13a-e9ce8ebf7590 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_members [ 1677.710132] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGHEST for action security_group_members [ 1677.710446] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.710566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.710633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.710876] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.711128] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1677.711694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1677.711694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1677.711694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1677.711694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1677.711694] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1678.213891] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.214102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.214177] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.214386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.214485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.214696] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.214822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.214854] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.214991] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.215084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.215172] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21328bb-ac07-4420-99ca-d686426c559d is going to be updated. [ 1678.253960] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.254122] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1678.254191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1678.254335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1678.254466] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1678.262354] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21328bb-ac07-4420-99ca-d686426c559d in Status: IN_PROGRESS for 2s [ 1680.272931] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21328bb-ac07-4420-99ca-d686426c559d in Status: SUCCESS [ 1680.273326] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21328bb-ac07-4420-99ca-d686426c559d deletion is rescheduled due to dependency. [ 1680.273326] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.354820] env[68828]: INFO networking_nsxv3.common.synchronization [None req-bf6570ce-19e9-4bc4-be9f-433f8ccb5568 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_rules [ 1682.355375] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_rules [ 1682.355710] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.355863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1682.355936] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.356330] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.356438] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1682.415508] env[68828]: INFO networking_nsxv3.common.synchronization [None req-0d0cc5e1-755f-4a52-b5de-90b1d6eb3ce7 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_rules [ 1682.415743] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_rules [ 1682.416277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.416383] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1682.877066] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.877197] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1682.877255] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.877471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.877563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.877664] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 already deleted. [ 1682.877747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1682.877893] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1682.878091] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1682.878128] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1683.398337] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1683.398702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1683.398702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1683.398767] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1683.398874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1683.398967] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 already deleted. [ 1683.399065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.416554] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1687.416864] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1687.583459] env[68828]: INFO networking_nsxv3.common.synchronization [req-fb4c0727-92bc-436d-ae90-670d6e4d88cf req-4fb5a869-5ad4-4059-b90c-4bab3e6e94a5 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_members [ 1687.583997] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_members [ 1687.584321] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.584442] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.584510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.584784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.584908] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.585013] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.585085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.585231] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.585312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.585453] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1687.813018] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.813018] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.813018] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.813018] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.813018] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.813495] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.813744] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.814074] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.814335] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.814666] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1687.814892] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] NeedRegenerationException {{(pid=68828) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1687.815128] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] no value, waiting for create lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1687.815416] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] value creation lock acquired {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1687.815758] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] No value present for key: 'zone-id' {{(pid=68828) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1687.815959] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Calling creation function for not-yet-present value {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1687.816214] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1687.837048] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1687.837048] env[68828]: DEBUG dogpile.cache.region [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68828) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1687.837048] env[68828]: DEBUG dogpile.lock [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Released creation lock {{(pid=68828) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1687.837233] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "network-392" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.837579] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock port-40780731-181b-401f-8cca-1abbebf987cc taken with stack trace [, , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.837808] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.838239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.838239] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.838388] env[68828]: DEBUG networking_nsxv3.api.rpc [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40780731-181b-401f-8cca-1abbebf987cc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1688.087346] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.087568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.087568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.087737] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.087829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.088038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.088139] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.088203] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.088352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.088427] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.088513] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 already deleted. [ 1688.088592] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.341086] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.341086] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.341282] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.341396] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.341555] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.341717] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Segment Port 40780731-181b-401f-8cca-1abbebf987cc not found, creating... [ 1688.341987] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.342161] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.342285] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.342510] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.342654] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.342935] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.343111] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.343235] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.343444] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.343582] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.343724] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Resource: SegmentPort with ID: 40780731-181b-401f-8cca-1abbebf987cc is going to be created. [ 1688.363728] env[68828]: DEBUG networking_nsxv3.common.locking [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.363943] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1688.364090] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1688.364337] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1688.364562] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1688.364786] env[68828]: DEBUG oslo_concurrency.lockutils [None req-b7cbcc63-b4d3-4329-b9a2-1916720b4a79 None None] Releasing lock "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.023038] env[68828]: INFO networking_nsxv3.common.synchronization [req-fb4c0727-92bc-436d-ae90-670d6e4d88cf req-af387e98-a572-479d-8a3e-f526bd0f5290 service nova] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_rules [ 1689.023038] env[68828]: INFO networking_nsxv3.common.synchronization [req-fb4c0727-92bc-436d-ae90-670d6e4d88cf req-af387e98-a572-479d-8a3e-f526bd0f5290 service nova] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_members [ 1689.023038] env[68828]: INFO networking_nsxv3.common.synchronization [req-fb4c0727-92bc-436d-ae90-670d6e4d88cf req-af387e98-a572-479d-8a3e-f526bd0f5290 service nova] Enqueued Resource ID: 40780731-181b-401f-8cca-1abbebf987cc with Priority: HIGHEST for action port [ 1689.023038] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_rules [ 1689.023038] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_members [ 1689.023038] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40780731-181b-401f-8cca-1abbebf987cc with Priority: HIGHEST for action port [ 1689.023038] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.023038] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.023754] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.024132] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.024296] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1689.025301] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.025518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.025667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.026244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.026244] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.026244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.026244] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.026516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.026516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.026516] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1689.028742] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock port-40780731-181b-401f-8cca-1abbebf987cc taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.028863] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.028939] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.029097] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.029176] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40780731-181b-401f-8cca-1abbebf987cc',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1689.531220] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.531361] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.531553] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1689.532432] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40780731-181b-401f-8cca-1abbebf987cc with status ACTIVE [ 1689.532621] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.532733] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.532985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.532985] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.533241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.533299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.533368] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.533436] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.533593] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.533662] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.533840] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.533934] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.533996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.534181] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.534228] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.534327] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40780731-181b-401f-8cca-1abbebf987cc is going to be updated. [ 1689.553450] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.553580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.553651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.553836] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.553966] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.554128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40780731-181b-401f-8cca-1abbebf987cc" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1690.035754] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1690.537952] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1690.538154] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1690.538196] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1690.538411] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1690.538504] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1690.538609] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 is going to be created. [ 1690.559399] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1690.559526] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1690.559566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1690.559711] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1690.559855] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1690.567976] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: UNINITIALIZED for 2s [ 1692.578519] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: SUCCESS [ 1692.578887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1692.578887] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1692.579084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1692.579273] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1692.579390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1692.579459] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1692.579610] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1692.579694] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1692.579780] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1692.579865] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1693.081704] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1693.583706] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46a66c1a-babc-4a03-8949-d1bc16891485: rpc.has_security_group_logging(os_id): False [ 1693.601043] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1693.601043] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1693.601245] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1693.601320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1693.601461] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1693.601738] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1693.601843] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1693.601908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1693.602082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1693.602163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1693.602249] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 is going to be created. [ 1693.677097] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1693.677213] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1693.677300] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1693.677510] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1693.677686] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1693.715097] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: IN_PROGRESS for 2s [ 1694.022922] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1694.023124] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1695.727577] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: SUCCESS [ 1695.727937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1699.024244] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1699.024574] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1704.025163] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1704.025462] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1709.026612] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1709.026612] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1714.027990] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1714.027990] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1719.029554] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1719.029554] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1724.030590] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1724.030590] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1729.032210] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1729.032608] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1733.912547] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1733.912910] env[68828]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d94b3d79-1345-4c08-9a98-fe1821cef990 None None] NSXv3 Agent Agent loop - iteration:5 started [ 1734.033596] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1734.033766] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1739.035291] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1739.035291] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1744.035853] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1744.036188] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1744.851946] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1744.851946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1744.851946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1744.852386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1744.852386] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.354331] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1745.856451] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1746.359854] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1746.359854] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1746.726580] env[68828]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/segments', 'params': {'page_size': 200, 'cursor': ''}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1746.726709] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=68828) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1749.037175] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1749.037441] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1749.432221] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.432457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.432457] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.432622] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.443926] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1749.444776] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.445831] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1749.484587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.484889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.484889] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.485026] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.498946] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.499648] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1749.499732] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1749.499820] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1749.528017] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.528162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.528235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.528433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.528783] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.528911] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1749.598882] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.599032] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.599080] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.599281] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.599590] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.599850] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1749.672909] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.673174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.673174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.673335] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.673627] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.673906] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 1749.673990] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7f3199ec-0e4d-4ae9-8c43-76701bbf9090', '33e63aa4-edf9-4cdd-b540-1791bfdc42d4', '46a66c1a-babc-4a03-8949-d1bc16891485', 'a21328bb-ac07-4420-99ca-d686426c559d', '0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff', 'a40c3045-d4de-46b9-862d-aaeccc547265', 'e9f41e17-e083-4115-b3db-6fcd432d4982', '4ccb4815-10bb-46a0-9b26-0a53fb6c8347'} {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1749.674074] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1749.692978] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.693136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.693136] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.693315] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.693397] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.693496] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1749.693568] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1749.693638] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1749.770027] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.770027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.770138] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.770275] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.771352] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.771621] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1749.771704] env[68828]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68828) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1749.771776] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1749.771844] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1749.771917] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 1749.771989] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGH for action security_group_rules [ 1749.772078] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGH for action security_group_rules [ 1749.772143] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGH for action security_group_rules [ 1749.772245] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGH for action security_group_rules [ 1749.772291] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGH for action security_group_rules [ 1749.772324] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGH for action security_group_rules [ 1749.772365] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGH for action security_group_rules [ 1749.772421] env[68828]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGH for action security_group_rules [ 1749.772488] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1749.772551] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1749.772740] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.772930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.772930] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.773076] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.773143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.773318] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.773409] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.773471] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.773608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.773679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.773983] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.773983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.774102] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.774163] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.774233] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.774398] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.774490] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.774547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.774706] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.775240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.775240] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.775240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.775240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.775240] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.775447] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.775447] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.775542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.775600] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.775729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.775799] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.775970] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.776070] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.776128] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.776260] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.776331] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.776488] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.776576] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.776633] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.776760] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.776829] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.776986] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.777083] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.777140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.777270] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.777338] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.777498] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.777586] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.777644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.777771] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.777841] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.777998] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.778099] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.778156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.778285] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.778355] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.778515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.778603] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.778661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.778788] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.778856] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.779060] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.779160] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.779219] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.779359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.779425] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.779587] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.779674] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.779731] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.779881] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.779958] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.780135] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.780224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.780280] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.780410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.780482] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.780642] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.780727] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.780784] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.780911] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.780980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.781150] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.781236] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.781293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.781455] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.781538] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.781705] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.781793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.781851] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.781980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.782061] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.782224] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.782344] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.782400] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.782492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.782561] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.782719] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.782812] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.782902] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.783055] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.783129] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.783292] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.783380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.783440] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.783571] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.783640] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.783830] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.783922] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.783980] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.784126] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.784195] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.784356] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.784443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.784501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.784629] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.784698] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.784856] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.784942] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.784998] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.785140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.785211] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.785370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.785458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.785517] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.785647] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.785719] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.785875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.785960] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.786027] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.786156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.786226] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.786384] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.786473] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.786703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.786703] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.786791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.786875] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.786961] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.787029] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.787161] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.787230] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.787389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.787477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.787535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.787661] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.787732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.787888] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.787974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.788042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.788171] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.788241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.788398] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.788485] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.788543] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.788669] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.788739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.788896] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.788981] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.789048] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.789178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.789263] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.789406] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.789495] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.789552] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.789679] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.789748] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.791503] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.791503] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.791503] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.791503] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.793721] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.793721] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.793721] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.794277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.794277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.794277] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.794277] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.794604] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.794604] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.794604] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.794908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.794908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.794908] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.794987] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.795036] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.795104] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.795235] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.795304] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.795463] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.795553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.795611] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.795739] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.795809] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.795968] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.796066] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.796124] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.796251] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.796321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.796480] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.796569] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.796625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.796752] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.796822] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.796981] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.797079] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.797137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.797268] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.797332] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.797492] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.797580] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.797637] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.797765] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.797834] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.797993] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.798092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.798149] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.798278] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.798348] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.798506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.798595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.798653] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.798781] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.798850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.799014] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.799105] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.799162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.799291] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.799359] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.799520] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.799609] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.799667] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.799793] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.799864] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.800031] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.800120] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.800178] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.800307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.800377] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.800538] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.800625] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.800682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.800808] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.800877] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.801046] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.801135] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.801192] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.801320] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.801416] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.801577] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.801668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.801738] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.801868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.801938] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.802111] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.802264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.802264] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.802380] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.802445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.802605] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.802691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.802747] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.802875] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.802945] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.803170] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.803290] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.803350] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.803489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.803563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.803747] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.803850] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.803909] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.804064] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.804137] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.804299] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.804390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.804449] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.804579] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.804649] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.804809] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.804894] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.804951] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.805092] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.805162] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.805322] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.805410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.805470] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.805598] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.805668] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.805827] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.805937] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.806015] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.806156] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.806227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.806389] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.806477] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.806535] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.806665] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.806735] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.806894] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.807103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.807103] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.807158] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.807292] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.807384] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.807474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.807530] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.807659] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.807729] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.807887] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.807974] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.808042] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.808172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.808241] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.808400] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.808487] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.808544] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.808671] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.808740] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.808897] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.808983] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.809053] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.809182] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.809259] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.809410] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.809497] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.809553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.809680] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.809750] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.809862] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1749.810062] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1749.810062] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1749.882452] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.882651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.882651] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.882832] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.883143] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.883407] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1749.952467] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1749.952654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1749.952654] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1749.952860] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1749.953174] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1749.968082] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.038058] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1754.038406] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=8], Jobs=0 [ 1754.038406] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 with Priority: HIGH for action security_group_rules [ 1754.038469] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGH for action security_group_rules [ 1754.038555] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f41e17-e083-4115-b3db-6fcd432d4982 with Priority: HIGH for action security_group_rules [ 1754.038617] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40c3045-d4de-46b9-862d-aaeccc547265 with Priority: HIGH for action security_group_rules [ 1754.038713] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 with Priority: HIGH for action security_group_rules [ 1754.038808] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff with Priority: HIGH for action security_group_rules [ 1754.038900] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 with Priority: HIGH for action security_group_rules [ 1754.038990] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21328bb-ac07-4420-99ca-d686426c559d with Priority: HIGH for action security_group_rules [ 1754.039357] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.039519] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.039587] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.039796] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.039876] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3199ec-0e4d-4ae9-8c43-76701bbf9090',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.040942] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.041563] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.041681] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.041867] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.041948] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.043245] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f41e17-e083-4115-b3db-6fcd432d4982 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.043354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.043422] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.043574] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.043648] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f41e17-e083-4115-b3db-6fcd432d4982',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.044347] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a40c3045-d4de-46b9-862d-aaeccc547265 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.044501] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.044541] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.044660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.044733] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a40c3045-d4de-46b9-862d-aaeccc547265',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.046063] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.046157] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.046187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.046445] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.046445] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ccb4815-10bb-46a0-9b26-0a53fb6c8347',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.047096] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.047207] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.047274] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.047433] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.047508] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.048278] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.048384] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.048452] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.048608] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.048713] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e63aa4-edf9-4cdd-b540-1791bfdc42d4',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.049370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21328bb-ac07-4420-99ca-d686426c559d taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.049492] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.049562] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.049714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.049787] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21328bb-ac07-4420-99ca-d686426c559d',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.554558] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.554714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.554714] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.554925] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.555067] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.555172] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.555234] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.555386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.555474] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.555564] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.555649] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1754.583506] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.583713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.583713] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.583891] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.585253] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.585354] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.586861] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.586970] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.603768] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.603873] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.604576] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.604673] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.605260] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.605360] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.606056] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.606168] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.606870] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.606980] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3199ec-0e4d-4ae9-8c43-76701bbf9090 is going to be deleted. [ 1754.607702] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.607883] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.624159] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.624271] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff is going to be deleted. [ 1754.624996] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.625191] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.643861] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.643988] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a40c3045-d4de-46b9-862d-aaeccc547265 is going to be deleted. [ 1754.644688] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.644862] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.778347] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.778512] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f41e17-e083-4115-b3db-6fcd432d4982 is going to be deleted. [ 1754.779343] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.779542] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.795520] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.795693] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.796262] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.796357] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.806553] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.806639] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e63aa4-edf9-4cdd-b540-1791bfdc42d4 is going to be deleted. [ 1754.807373] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.807568] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.828224] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.828333] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ccb4815-10bb-46a0-9b26-0a53fb6c8347 is going to be deleted. [ 1754.829065] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.829250] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.830466] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.830557] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.838547] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.838660] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.877534] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1754.877691] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1754.878913] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.879046] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21328bb-ac07-4420-99ca-d686426c559d is going to be deleted. [ 1754.879874] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.880085] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.880173] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.880293] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3199ec-0e4d-4ae9-8c43-76701bbf9090" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.880443] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.880601] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.880682] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.880791] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f8d10e5-3f7f-4005-acfc-a08c1e1ac8ff" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.881227] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.881386] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.881489] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.881607] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a40c3045-d4de-46b9-862d-aaeccc547265" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.881732] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.881871] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.881947] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.882063] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f41e17-e083-4115-b3db-6fcd432d4982" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.882186] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1754.882321] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1754.882394] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1754.882494] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e63aa4-edf9-4cdd-b540-1791bfdc42d4" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.028863] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.029045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.029084] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.029307] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.029410] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.029547] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ccb4815-10bb-46a0-9b26-0a53fb6c8347" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.030278] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.030390] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.030458] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.030618] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.030697] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.030803] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21328bb-ac07-4420-99ca-d686426c559d" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.061212] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1755.564231] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46a66c1a-babc-4a03-8949-d1bc16891485: rpc.has_security_group_logging(os_id): False [ 1755.582892] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.583045] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.583112] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.583327] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.602566] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.602940] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.603075] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.603140] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.603325] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.603407] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.604032] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 is going to be updated. [ 1755.658084] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1755.658257] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1755.658312] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1755.658518] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1755.658664] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1755.687981] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: IN_PROGRESS for 2s [ 1757.702871] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: SUCCESS [ 1757.703142] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1759.039603] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1759.039976] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1764.040298] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1764.040599] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1765.655660] env[68828]: INFO networking_nsxv3.common.synchronization [req-178578b3-f7bf-4dfc-a924-871c56bf5892 req-60fdc6ad-c3b0-45fb-ba70-b59ad0e34903 tempest-AttachVolumeTestJSON-1381856400 tempest-AttachVolumeTestJSON-1381856400-project-member] Enqueued Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_members [ 1765.656207] env[68828]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a66c1a-babc-4a03-8949-d1bc16891485 with Priority: HIGHEST for action security_group_members [ 1765.656515] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock member-46a66c1a-babc-4a03-8949-d1bc16891485 taken with stack trace [, , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.656644] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.656710] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.657370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.657370] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1765.657370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1765.657370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1765.657370] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1765.657716] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1765.657716] env[68828]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46a66c1a-babc-4a03-8949-d1bc16891485',) {} {{(pid=68828) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1766.160212] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.160417] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.160595] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.160833] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.160987] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.161305] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.161479] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.161583] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.161844] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.161976] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.162142] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 is going to be updated. [ 1766.190633] env[68828]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68828) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1766.190823] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1766.190868] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1766.191050] env[68828]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1766.191187] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1766.198736] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: IN_PROGRESS for 2s [ 1768.210177] env[68828]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46a66c1a-babc-4a03-8949-d1bc16891485 in Status: SUCCESS [ 1768.210516] env[68828]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46a66c1a-babc-4a03-8949-d1bc16891485 deletion is rescheduled due to dependency. [ 1768.210516] env[68828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46a66c1a-babc-4a03-8949-d1bc16891485" {{(pid=68828) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1770.657268] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1770.657661] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1775.658034] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1775.658347] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1780.658832] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1780.659216] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1785.660510] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1785.660828] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1790.661978] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1790.662315] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1795.663452] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1795.663843] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1800.665454] env[68828]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1800.665867] env[68828]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0